2026-03-25 22:45:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 22:45:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 22:45:06 [ayvens.be] INFO: Starting spider ayvens.be
2026-03-25 22:45:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 22:45:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 22:45:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 22:45:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 22:45:06 [scrapy.extensions.telnet] INFO: Telnet Password: 077e5fbaddf7710e
2026-03-25 22:45:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 22:45:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.be/task_34_2026-03-25T22_45_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 22:45:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 22:45:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 22:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-25 22:45:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 22:45:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-25 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 22:45:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-25 22:45:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 22:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-25 22:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-25 22:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-25 22:45:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-25 22:45:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-25 22:45:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-25 22:45:06 [scrapy.core.engine] INFO: Spider opened
2026-03-25 22:45:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 22:45:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 22:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-25 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-25 22:45:06 [scrapy-playwright] INFO: Starting download handler
2026-03-25 22:45:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-25 22:45:12 [scrapy-playwright] INFO: Browser firefox launched
2026-03-25 22:45:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-25 22:45:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-25 22:45:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 22:45:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 22:45:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7JYRLYWD.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7JYRLYWD.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-25 22:45:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 22:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-25 22:45:17 [ayvens.be] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': '9nvxviIzaAl5wHC9JuSFuQ|2026-03-25T22:45:16.114Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806014716, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'yfg/XC7feds/BGfu4tBtlN|1774478717602|1774478717602', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774480517, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-25 22:45:17 [ayvens.be] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': '9nvxviIzaAl5wHC9JuSFuQ|2026-03-25T22:45:16.114Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'yfg/XC7feds/BGfu4tBtlN|1774478717602|1774478717602', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-25 22:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-25 22:45:17 [ayvens.be] INFO: Intercepting token...
2026-03-25 22:45:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-25 22:45:18 [ayvens.be] INFO: Scrolling element to trigger lazy load...
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:18 [ayvens.be] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-25 22:45:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-03-25 22:45:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-03-25 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-03-25 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 22:45:20 [ayvens.be] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-25 22:45:20 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-25 22:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:45:22 [ayvens.be] INFO: Found listing with ID: 1982154
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [ayvens.be] INFO: Scrape type for 1982154: 1
2026-03-25 22:45:22 [ayvens.be] INFO: Extracting data for car ID: 1982154
2026-03-25 22:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-25 22:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 1
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/1.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/2.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/3.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/4.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/5.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/6.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/7.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/8.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/9.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/10.jpg not downloaded yet
2026-03-25 22:45:22 [ayvens.be] INFO: Found listing with ID: 1982155
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982155%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [ayvens.be] INFO: Scrape type for 1982155: 1
2026-03-25 22:45:22 [ayvens.be] INFO: Extracting data for car ID: 1982155
2026-03-25 22:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab4ee28b-2ba1-5751-897f-eb30ad612da4 with identifier: 1982155
2026-03-25 22:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab4ee28b-2ba1-5751-897f-eb30ad612da4 with scrape type 1
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/1.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/2.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/3.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/4.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/5.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/6.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/7.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/8.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/9.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/10.jpg not downloaded yet
2026-03-25 22:45:22 [ayvens.be] INFO: Found listing with ID: 1982156
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982156%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [ayvens.be] INFO: Scrape type for 1982156: 1
2026-03-25 22:45:22 [ayvens.be] INFO: Extracting data for car ID: 1982156
2026-03-25 22:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4fab10c-7c75-56fc-a3ad-269be6cacd81 with identifier: 1982156
2026-03-25 22:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fab10c-7c75-56fc-a3ad-269be6cacd81 with scrape type 1
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/1.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/2.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/3.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/4.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/5.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/6.jpg not downloaded yet
2026-03-25 22:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/7.jpg not downloaded yet
2026-03-25 22:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/8.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/9.jpg not downloaded yet
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/10.jpg not downloaded yet
2026-03-25 22:45:22 [ayvens.be] INFO: Found listing with ID: 1982157
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982157%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [ayvens.be] INFO: Scrape type for 1982157: 1
2026-03-25 22:45:22 [ayvens.be] INFO: Extracting data for car ID: 1982157
2026-03-25 22:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with identifier: 1982157
2026-03-25 22:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with scrape type 1
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/1.jpg not downloaded yet
2026-03-25 22:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/2.jpg not downloaded yet
2026-03-25 22:45:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 22:45:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 22:45:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b4fd0>
2026-03-25 22:45:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/5.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879ae90>
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/4.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878a990>
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/3.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/3.jpg not downloaded yet
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21522250>
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/7.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/4.jpg not downloaded yet
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/5.jpg not downloaded yet
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/6.jpg not downloaded yet
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/7.jpg not downloaded yet
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/8.jpg not downloaded yet
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/9.jpg not downloaded yet
2026-03-25 22:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151b8d0>
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/9.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236db010>
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/1.jpg saved to cache
2026-03-25 22:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/10.jpg not downloaded yet
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e9e50>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/6.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:24 [ayvens.be] INFO: Found listing with ID: 1982158
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982158%27 HTTP/1.1" 200 None
2026-03-25 22:45:24 [ayvens.be] INFO: Scrape type for 1982158: 1
2026-03-25 22:45:24 [ayvens.be] INFO: Extracting data for car ID: 1982158
2026-03-25 22:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with identifier: 1982158
2026-03-25 22:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with scrape type 1
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/1.jpg not downloaded yet
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/2.jpg not downloaded yet
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839ecd0>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/8.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236af610>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/10.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28798050>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7a763c500b9944238ee87b403443f6d2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/2.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c
2026-03-25 22:45:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2adc822b-9525-57aa-a6fd-5dac6ff9009c, skipping ID generation
2026-03-25 22:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c with scrape type 1
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2adc822b-9525-57aa-a6fd-5dac6ff9009c sending to next pipeline
2026-03-25 22:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2adc822b-9525-57aa-a6fd-5dac6ff9009c, identifier: 1982154
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28789d90>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/1.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a849a50>
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/2.jpg saved to cache
2026-03-25 22:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-25 22:45:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154
2026-03-25 22:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2adc822b-9525-57aa-a6fd-5dac6ff9009c with identifier: 1982154 to the API
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '2adc822b-9525-57aa-a6fd-5dac6ff9009c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2adc822b-9525-57aa-a6fd-5dac6ff9009c/2adc822b-9525-57aa-a6fd-5dac6ff9009c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7a763c500b9944238ee87b403443f6d2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982154%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [ayvens.be] INFO: Saving data for 1982154: {'created_time': 1774478725.315373, 'last_price_update_time': 1774478725.315385, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982154') HTTP/1.1" 204 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/3.jpg not downloaded yet
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/4.jpg not downloaded yet
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/5.jpg not downloaded yet
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/6.jpg not downloaded yet
2026-03-25 22:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/7.jpg not downloaded yet
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/8.jpg not downloaded yet
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/9.jpg not downloaded yet
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/10.jpg not downloaded yet
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28777450>
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/5.jpg saved to cache
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361c990>
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/4.jpg saved to cache
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28826bd0>
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/3.jpg saved to cache
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23692b90>
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/4.jpg saved to cache
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9790>
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/5.jpg saved to cache
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:25 [ayvens.be] INFO: Found listing with ID: 1982159
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982159%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [ayvens.be] INFO: Scrape type for 1982159: 1
2026-03-25 22:45:25 [ayvens.be] INFO: Extracting data for car ID: 1982159
2026-03-25 22:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f191d63-a126-549d-96d5-372f1e674922 with identifier: 1982159
2026-03-25 22:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f191d63-a126-549d-96d5-372f1e674922 with scrape type 1
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/1.jpg not downloaded yet
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b3805dd50>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/6.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21526350>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/1.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/2.jpg not downloaded yet
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/3.jpg not downloaded yet
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9e90>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/6.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/4.jpg not downloaded yet
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/5.jpg not downloaded yet
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e43950>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/3.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/6.jpg not downloaded yet
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/7.jpg not downloaded yet
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/8.jpg not downloaded yet
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff6fd0>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/2.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287414d0>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/4.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/9.jpg not downloaded yet
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/10.jpg not downloaded yet
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28906dd0>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/5.jpg saved to cache
2026-03-25 22:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879b710>
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/10.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28818a90>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/9.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369d390>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/10.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eaed0>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/8.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:27 [ayvens.be] INFO: Found listing with ID: 1982160
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982160%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [ayvens.be] INFO: Scrape type for 1982160: 1
2026-03-25 22:45:27 [ayvens.be] INFO: Extracting data for car ID: 1982160
2026-03-25 22:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90c86a0-f470-5317-bf59-c52a5446e204 with identifier: 1982160
2026-03-25 22:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90c86a0-f470-5317-bf59-c52a5446e204 with scrape type 1
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/1.jpg not downloaded yet
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/2.jpg not downloaded yet
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/3.jpg not downloaded yet
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/4.jpg not downloaded yet
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/5.jpg not downloaded yet
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/6.jpg not downloaded yet
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/7.jpg not downloaded yet
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881c5d0>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/3.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/8.jpg not downloaded yet
2026-03-25 22:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/9.jpg not downloaded yet
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23642850>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/2.jpg saved to cache
2026-03-25 22:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64d3d0>
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/4.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ad10>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/1.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7210>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/7.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b46d0>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/1.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b64d0>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/9.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/10.jpg not downloaded yet
2026-03-25 22:45:28 [ayvens.be] INFO: Found listing with ID: 1982161
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982161%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [ayvens.be] INFO: Scrape type for 1982161: 1
2026-03-25 22:45:28 [ayvens.be] INFO: Extracting data for car ID: 1982161
2026-03-25 22:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2f007e-e7f0-5e12-98ff-b4a581977486 with identifier: 1982161
2026-03-25 22:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2f007e-e7f0-5e12-98ff-b4a581977486 with scrape type 1
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/1.jpg not downloaded yet
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a5650>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/10.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/2.jpg not downloaded yet
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/3.jpg not downloaded yet
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/4.jpg not downloaded yet
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21525350>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/3.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/5.jpg not downloaded yet
2026-03-25 22:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/6.jpg not downloaded yet
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369d2d0>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/2.jpg saved to cache
2026-03-25 22:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28818fd0>
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/5.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a361dd0>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/4.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766250>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/6.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/7.jpg not downloaded yet
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/8.jpg not downloaded yet
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22b10>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/8.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e9110>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/8.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/9.jpg not downloaded yet
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/10.jpg not downloaded yet
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eb310>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/7.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:29 [ayvens.be] INFO: Found listing with ID: 1982162
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982162%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [ayvens.be] INFO: Scrape type for 1982162: 1
2026-03-25 22:45:29 [ayvens.be] INFO: Extracting data for car ID: 1982162
2026-03-25 22:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4574d2a-0e38-503a-83fb-300d5056238e with identifier: 1982162
2026-03-25 22:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4574d2a-0e38-503a-83fb-300d5056238e with scrape type 1
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/1.jpg not downloaded yet
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/2.jpg not downloaded yet
2026-03-25 22:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/3.jpg not downloaded yet
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28937150>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/3.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28830050>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/1.jpg saved to cache
2026-03-25 22:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eaa90>
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/2.jpg saved to cache
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/4.jpg not downloaded yet
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/5.jpg not downloaded yet
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361fd50>
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/9.jpg saved to cache
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f9b10>
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/7.jpg saved to cache
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215289d0>
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F45c8055e2e3749ee9a160ae19da0e78c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/10.jpg saved to cache
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f191d63-a126-549d-96d5-372f1e674922
2026-03-25 22:45:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f191d63-a126-549d-96d5-372f1e674922, skipping ID generation
2026-03-25 22:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f191d63-a126-549d-96d5-372f1e674922 with scrape type 1
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f191d63-a126-549d-96d5-372f1e674922 sending to next pipeline
2026-03-25 22:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5f191d63-a126-549d-96d5-372f1e674922, identifier: 1982159
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/6.jpg not downloaded yet
2026-03-25 22:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5f191d63-a126-549d-96d5-372f1e674922 with identifier: 1982159
2026-03-25 22:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5f191d63-a126-549d-96d5-372f1e674922 with identifier: 1982159
2026-03-25 22:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5f191d63-a126-549d-96d5-372f1e674922 with identifier: 1982159 to the API
2026-03-25 22:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f191d63-a126-549d-96d5-372f1e674922',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 97601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f191d63-a126-549d-96d5-372f1e674922/5f191d63-a126-549d-96d5-372f1e674922_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/45c8055e2e3749ee9a160ae19da0e78c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982159%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [ayvens.be] INFO: Saving data for 1982159: {'created_time': 1774478731.442311, 'last_price_update_time': 1774478731.442323, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982159') HTTP/1.1" 204 0
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/7.jpg not downloaded yet
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/8.jpg not downloaded yet
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790b10>
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/9.jpg saved to cache
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/9.jpg not downloaded yet
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/10.jpg not downloaded yet
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28792e10>
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/2.jpg saved to cache
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:31 [ayvens.be] INFO: Found listing with ID: 1982163
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982163%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [ayvens.be] INFO: Scrape type for 1982163: 1
2026-03-25 22:45:31 [ayvens.be] INFO: Extracting data for car ID: 1982163
2026-03-25 22:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bfde06-dc5a-59ef-823c-da11dce863c7 with identifier: 1982163
2026-03-25 22:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bfde06-dc5a-59ef-823c-da11dce863c7 with scrape type 1
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/1.jpg not downloaded yet
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/2.jpg not downloaded yet
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/3.jpg not downloaded yet
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac5e10>
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/1.jpg saved to cache
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28798f90>
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/3.jpg saved to cache
2026-03-25 22:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b29267090>
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/8.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28767550>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/10.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a53bd50>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/7.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/4.jpg not downloaded yet
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/5.jpg not downloaded yet
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e43a90>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/4.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f3410>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/6.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/6.jpg not downloaded yet
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/7.jpg not downloaded yet
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/8.jpg not downloaded yet
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21512650>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/7.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/9.jpg not downloaded yet
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/10.jpg not downloaded yet
2026-03-25 22:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:32 [ayvens.be] INFO: Found listing with ID: 1982164
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982164%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [ayvens.be] INFO: Scrape type for 1982164: 1
2026-03-25 22:45:32 [ayvens.be] INFO: Extracting data for car ID: 1982164
2026-03-25 22:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e478ec9f-310a-5a32-83e3-4dbef4d3230b with identifier: 1982164
2026-03-25 22:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e478ec9f-310a-5a32-83e3-4dbef4d3230b with scrape type 1
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/1.jpg not downloaded yet
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369dd50>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/10.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e7790>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/8.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892fe50>
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/1.jpg saved to cache
2026-03-25 22:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/2.jpg not downloaded yet
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/3.jpg not downloaded yet
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/4.jpg not downloaded yet
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff67d0>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/2.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283ab2d0>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/3.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515d90>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/6.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21518e90>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/9.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516410>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/5.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/5.jpg not downloaded yet
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/6.jpg not downloaded yet
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/7.jpg not downloaded yet
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/8.jpg not downloaded yet
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/9.jpg not downloaded yet
2026-03-25 22:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/10.jpg not downloaded yet
2026-03-25 22:45:33 [ayvens.be] INFO: Found listing with ID: 1982165
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982165%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [ayvens.be] INFO: Scrape type for 1982165: 1
2026-03-25 22:45:33 [ayvens.be] INFO: Extracting data for car ID: 1982165
2026-03-25 22:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1982165
2026-03-25 22:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ea013f-70b4-5b19-89cd-347303b90006 with scrape type 1
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/1.jpg not downloaded yet
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/2.jpg not downloaded yet
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668710>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/7.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28748c50>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/2.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ea490>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/3.jpg saved to cache
2026-03-25 22:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eafd0>
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/4.jpg saved to cache
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/3.jpg not downloaded yet
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28936cd0>
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/6.jpg saved to cache
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890ca90>
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ya%252F0b068c5d9d7e41a0a19ef0d6fcc76825%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/5.jpg saved to cache
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc2f007e-e7f0-5e12-98ff-b4a581977486
2026-03-25 22:45:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc2f007e-e7f0-5e12-98ff-b4a581977486, skipping ID generation
2026-03-25 22:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2f007e-e7f0-5e12-98ff-b4a581977486 with scrape type 1
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc2f007e-e7f0-5e12-98ff-b4a581977486 sending to next pipeline
2026-03-25 22:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc2f007e-e7f0-5e12-98ff-b4a581977486, identifier: 1982161
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/4.jpg not downloaded yet
2026-03-25 22:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc2f007e-e7f0-5e12-98ff-b4a581977486 with identifier: 1982161
2026-03-25 22:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc2f007e-e7f0-5e12-98ff-b4a581977486 with identifier: 1982161
2026-03-25 22:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc2f007e-e7f0-5e12-98ff-b4a581977486 with identifier: 1982161 to the API
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc2f007e-e7f0-5e12-98ff-b4a581977486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 54694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc2f007e-e7f0-5e12-98ff-b4a581977486/dc2f007e-e7f0-5e12-98ff-b4a581977486_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ya/0b068c5d9d7e41a0a19ef0d6fcc76825/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982161%27 HTTP/1.1" 200 None
2026-03-25 22:45:34 [ayvens.be] INFO: Saving data for 1982161: {'created_time': 1774478734.892001, 'last_price_update_time': 1774478734.892018, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982161') HTTP/1.1" 204 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/5.jpg not downloaded yet
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28915c10>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/8.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c12190>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/1.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/6.jpg not downloaded yet
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/7.jpg not downloaded yet
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/8.jpg not downloaded yet
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/9.jpg not downloaded yet
2026-03-25 22:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/10.jpg not downloaded yet
2026-03-25 22:45:35 [ayvens.be] INFO: Found listing with ID: 1982166
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982166%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [ayvens.be] INFO: Scrape type for 1982166: 1
2026-03-25 22:45:35 [ayvens.be] INFO: Extracting data for car ID: 1982166
2026-03-25 22:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1982166
2026-03-25 22:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with scrape type 1
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/1.jpg not downloaded yet
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/2.jpg not downloaded yet
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21527490>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/4.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21525c50>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/5.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215150d0>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/7.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288eb2d0>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/2.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799850>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/1.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9f50>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/6.jpg saved to cache
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/3.jpg not downloaded yet
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a84a9d0>
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/8.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23612b90>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/10.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/4.jpg not downloaded yet
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/5.jpg not downloaded yet
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/6.jpg not downloaded yet
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/7.jpg not downloaded yet
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/8.jpg not downloaded yet
2026-03-25 22:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/9.jpg not downloaded yet
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/10.jpg not downloaded yet
2026-03-25 22:45:36 [ayvens.be] INFO: Found listing with ID: 1982167
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982167%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [ayvens.be] INFO: Scrape type for 1982167: 1
2026-03-25 22:45:36 [ayvens.be] INFO: Extracting data for car ID: 1982167
2026-03-25 22:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3546b3e-e1ce-5693-bd03-a57a08da25a4 with identifier: 1982167
2026-03-25 22:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3546b3e-e1ce-5693-bd03-a57a08da25a4 with scrape type 1
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/1.jpg not downloaded yet
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/2.jpg not downloaded yet
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7c250>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/3.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8990>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/5.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1a950>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/4.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f9c50>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/6.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a18550>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/10.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bf850>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/7.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a07a10>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/3.jpg saved to cache
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/3.jpg not downloaded yet
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aee7d0>
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7a30dd2e301b4c54a7f497033a80bac4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/9.jpg saved to cache
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73bfde06-dc5a-59ef-823c-da11dce863c7
2026-03-25 22:45:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73bfde06-dc5a-59ef-823c-da11dce863c7, skipping ID generation
2026-03-25 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bfde06-dc5a-59ef-823c-da11dce863c7 with scrape type 1
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73bfde06-dc5a-59ef-823c-da11dce863c7 sending to next pipeline
2026-03-25 22:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73bfde06-dc5a-59ef-823c-da11dce863c7, identifier: 1982163
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/4.jpg not downloaded yet
2026-03-25 22:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73bfde06-dc5a-59ef-823c-da11dce863c7 with identifier: 1982163
2026-03-25 22:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73bfde06-dc5a-59ef-823c-da11dce863c7 with identifier: 1982163
2026-03-25 22:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73bfde06-dc5a-59ef-823c-da11dce863c7 with identifier: 1982163 to the API
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '73bfde06-dc5a-59ef-823c-da11dce863c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 53969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfde06-dc5a-59ef-823c-da11dce863c7/73bfde06-dc5a-59ef-823c-da11dce863c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7a30dd2e301b4c54a7f497033a80bac4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982163%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [ayvens.be] INFO: Saving data for 1982163: {'created_time': 1774478737.699967, 'last_price_update_time': 1774478737.699979, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982163') HTTP/1.1" 204 0
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/5.jpg not downloaded yet
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/6.jpg not downloaded yet
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/7.jpg not downloaded yet
2026-03-25 22:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/8.jpg not downloaded yet
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/9.jpg not downloaded yet
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/10.jpg not downloaded yet
2026-03-25 22:45:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7850>
2026-03-25 22:45:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/5.jpg saved to cache
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:37 [ayvens.be] INFO: Found listing with ID: 1982168
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982168%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [ayvens.be] INFO: Scrape type for 1982168: 1
2026-03-25 22:45:37 [ayvens.be] INFO: Extracting data for car ID: 1982168
2026-03-25 22:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf8d0e46-9bf4-5289-9929-15c67aea8157 with identifier: 1982168
2026-03-25 22:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf8d0e46-9bf4-5289-9929-15c67aea8157 with scrape type 1
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/1.jpg not downloaded yet
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/2.jpg not downloaded yet
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28395390>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/1.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28830c90>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/2.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890f0d0>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/10.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7e790>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/6.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503c10>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/9.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28833dd0>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/4.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8fd0>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/3.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/3.jpg not downloaded yet
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/4.jpg not downloaded yet
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/5.jpg not downloaded yet
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/6.jpg not downloaded yet
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/7.jpg not downloaded yet
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/8.jpg not downloaded yet
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/9.jpg not downloaded yet
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877ea90>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/5.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/10.jpg not downloaded yet
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901ec10>
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/6.jpg saved to cache
2026-03-25 22:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:38 [ayvens.be] INFO: Found listing with ID: 1982169
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982169%27 HTTP/1.1" 200 None
2026-03-25 22:45:38 [ayvens.be] INFO: Scrape type for 1982169: 1
2026-03-25 22:45:38 [ayvens.be] INFO: Extracting data for car ID: 1982169
2026-03-25 22:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47c5484-1100-55a0-bd8d-21e13244e7f2 with identifier: 1982169
2026-03-25 22:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47c5484-1100-55a0-bd8d-21e13244e7f2 with scrape type 1
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/1.jpg not downloaded yet
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/2.jpg not downloaded yet
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c2190>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/4.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a523d0>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/1.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2152b110>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/2.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad310>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/10.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c3610>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/3.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a537d0>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/7.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/3.jpg not downloaded yet
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/4.jpg not downloaded yet
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/5.jpg not downloaded yet
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/6.jpg not downloaded yet
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/7.jpg not downloaded yet
2026-03-25 22:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/8.jpg not downloaded yet
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/9.jpg not downloaded yet
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21520090>
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/3.jpg saved to cache
2026-03-25 22:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/10.jpg not downloaded yet
2026-03-25 22:45:40 [ayvens.be] INFO: Found listing with ID: 1982170
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982170%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [ayvens.be] INFO: Scrape type for 1982170: 1
2026-03-25 22:45:40 [ayvens.be] INFO: Extracting data for car ID: 1982170
2026-03-25 22:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b76150a-95b6-5800-8694-d5562a33e0d7 with identifier: 1982170
2026-03-25 22:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b76150a-95b6-5800-8694-d5562a33e0d7 with scrape type 1
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/1.jpg not downloaded yet
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/2.jpg not downloaded yet
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4d50>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/1.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215150d0>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/5.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884b690>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/4.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21517490>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/2.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bbc10>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/10.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28927410>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/8.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925590>
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/9.jpg saved to cache
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/3.jpg not downloaded yet
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/4.jpg not downloaded yet
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/5.jpg not downloaded yet
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/6.jpg not downloaded yet
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/7.jpg not downloaded yet
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/8.jpg not downloaded yet
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/9.jpg not downloaded yet
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/10.jpg not downloaded yet
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288483d0>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/4.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:41 [ayvens.be] INFO: Found listing with ID: 1982171
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982171%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [ayvens.be] INFO: Scrape type for 1982171: 1
2026-03-25 22:45:41 [ayvens.be] INFO: Extracting data for car ID: 1982171
2026-03-25 22:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7720b580-e0d9-5118-81ab-1662da1bac35 with identifier: 1982171
2026-03-25 22:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7720b580-e0d9-5118-81ab-1662da1bac35 with scrape type 1
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/1.jpg not downloaded yet
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878a310>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/10.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ebc50>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/7.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/2.jpg not downloaded yet
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/3.jpg not downloaded yet
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fa150>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/2.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364bb90>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/9.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aefa90>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/6.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741350>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/8.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b8450>
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/7.jpg saved to cache
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/4.jpg not downloaded yet
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/5.jpg not downloaded yet
2026-03-25 22:45:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/6.jpg not downloaded yet
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/7.jpg not downloaded yet
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/8.jpg not downloaded yet
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/9.jpg not downloaded yet
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/10.jpg not downloaded yet
2026-03-25 22:45:42 [ayvens.be] INFO: Found listing with ID: 1982172
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982172%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [ayvens.be] INFO: Scrape type for 1982172: 1
2026-03-25 22:45:42 [ayvens.be] INFO: Extracting data for car ID: 1982172
2026-03-25 22:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3b026f-df37-5e78-bea5-d891cc71bb04 with identifier: 1982172
2026-03-25 22:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3b026f-df37-5e78-bea5-d891cc71bb04 with scrape type 1
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/1.jpg not downloaded yet
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/2.jpg not downloaded yet
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364b710>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/2.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7b150>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/5.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa3610>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/4.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ba090>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/3.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790050>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/3.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af350>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/1.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa3b90>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/6.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac3790>
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/6.jpg saved to cache
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/3.jpg not downloaded yet
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/4.jpg not downloaded yet
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/5.jpg not downloaded yet
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/6.jpg not downloaded yet
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/7.jpg not downloaded yet
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/8.jpg not downloaded yet
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/9.jpg not downloaded yet
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/10.jpg not downloaded yet
2026-03-25 22:45:43 [ayvens.be] INFO: Found listing with ID: 1982173
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982173%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [ayvens.be] INFO: Scrape type for 1982173: 1
2026-03-25 22:45:43 [ayvens.be] INFO: Extracting data for car ID: 1982173
2026-03-25 22:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcf20b2-5900-5b9a-8816-601bbf704701 with identifier: 1982173
2026-03-25 22:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcf20b2-5900-5b9a-8816-601bbf704701 with scrape type 1
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/1.jpg not downloaded yet
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880af90>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/2.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/2.jpg not downloaded yet
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e3650>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/1.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b0bf90>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/4.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23689ad0>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/10.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926b90>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/2.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bbc10>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/5.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884b950>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/1.jpg saved to cache
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/3.jpg not downloaded yet
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/4.jpg not downloaded yet
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364bb90>
2026-03-25 22:45:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/10.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/5.jpg not downloaded yet
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/6.jpg not downloaded yet
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23602f10>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/3.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368cd90>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/2.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/7.jpg not downloaded yet
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/8.jpg not downloaded yet
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/9.jpg not downloaded yet
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21523250>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/1.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b150>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/4.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/10.jpg not downloaded yet
2026-03-25 22:45:44 [ayvens.be] INFO: Found listing with ID: 1982174
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982174%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [ayvens.be] INFO: Scrape type for 1982174: 1
2026-03-25 22:45:44 [ayvens.be] INFO: Extracting data for car ID: 1982174
2026-03-25 22:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9235a2ca-21a3-55b3-8c79-28af6742234a with identifier: 1982174
2026-03-25 22:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235a2ca-21a3-55b3-8c79-28af6742234a with scrape type 1
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/1.jpg not downloaded yet
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42890>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/7.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c97d0>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/8.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fc5d0>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/10.jpg saved to cache
2026-03-25 22:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9d50>
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/9.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/2.jpg not downloaded yet
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/3.jpg not downloaded yet
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/4.jpg not downloaded yet
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23642690>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/5.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff43d0>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/4.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/5.jpg not downloaded yet
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/6.jpg not downloaded yet
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ff710>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/6.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff7dd0>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/6.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/7.jpg not downloaded yet
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/8.jpg not downloaded yet
2026-03-25 22:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/9.jpg not downloaded yet
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603c10>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/7.jpg saved to cache
2026-03-25 22:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21510550>
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/5.jpg saved to cache
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/10.jpg not downloaded yet
2026-03-25 22:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:46 [ayvens.be] INFO: Found listing with ID: 1982175
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982175%27 HTTP/1.1" 200 None
2026-03-25 22:45:46 [ayvens.be] INFO: Scrape type for 1982175: 1
2026-03-25 22:45:46 [ayvens.be] INFO: Extracting data for car ID: 1982175
2026-03-25 22:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde98efd-c29c-519d-85d5-d6577600352c with identifier: 1982175
2026-03-25 22:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde98efd-c29c-519d-85d5-d6577600352c with scrape type 1
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/1.jpg not downloaded yet
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28791590>
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0d0b1a4a91d4462c94f174278fd2c6a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/3.jpg saved to cache
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7720b580-e0d9-5118-81ab-1662da1bac35
2026-03-25 22:45:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7720b580-e0d9-5118-81ab-1662da1bac35, skipping ID generation
2026-03-25 22:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7720b580-e0d9-5118-81ab-1662da1bac35 with scrape type 1
2026-03-25 22:45:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7720b580-e0d9-5118-81ab-1662da1bac35 sending to next pipeline
2026-03-25 22:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7720b580-e0d9-5118-81ab-1662da1bac35, identifier: 1982171
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6e290>
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/2.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1b710>
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/3.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/2.jpg not downloaded yet
2026-03-25 22:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7720b580-e0d9-5118-81ab-1662da1bac35 with identifier: 1982171
2026-03-25 22:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7720b580-e0d9-5118-81ab-1662da1bac35 with identifier: 1982171
2026-03-25 22:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7720b580-e0d9-5118-81ab-1662da1bac35 with identifier: 1982171 to the API
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '7720b580-e0d9-5118-81ab-1662da1bac35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 49474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7720b580-e0d9-5118-81ab-1662da1bac35/7720b580-e0d9-5118-81ab-1662da1bac35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0d0b1a4a91d4462c94f174278fd2c6a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982171%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [ayvens.be] INFO: Saving data for 1982171: {'created_time': 1774478747.506854, 'last_price_update_time': 1774478747.506864, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982171') HTTP/1.1" 204 0
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa7450>
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/1.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/3.jpg not downloaded yet
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23640e10>
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/4.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d6010>
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/10.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/4.jpg not downloaded yet
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/5.jpg not downloaded yet
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6e790>
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/7.jpg saved to cache
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/6.jpg not downloaded yet
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/7.jpg not downloaded yet
2026-03-25 22:45:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/8.jpg not downloaded yet
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23657a10>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/5.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/9.jpg not downloaded yet
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/10.jpg not downloaded yet
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bcb510>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/6.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d78d0>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/8.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fe890>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/2.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a21f50>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/1.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:48 [ayvens.be] INFO: Found listing with ID: 1982176
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982176%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [ayvens.be] INFO: Scrape type for 1982176: 1
2026-03-25 22:45:48 [ayvens.be] INFO: Extracting data for car ID: 1982176
2026-03-25 22:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with identifier: 1982176
2026-03-25 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with scrape type 1
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/1.jpg not downloaded yet
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/2.jpg not downloaded yet
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/3.jpg not downloaded yet
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f550>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/9.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21525310>
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xf%252F103397b1e65347a3a5faa4d51ed41435%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/10.jpg saved to cache
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fcf20b2-5900-5b9a-8816-601bbf704701
2026-03-25 22:45:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fcf20b2-5900-5b9a-8816-601bbf704701, skipping ID generation
2026-03-25 22:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcf20b2-5900-5b9a-8816-601bbf704701 with scrape type 1
2026-03-25 22:45:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fcf20b2-5900-5b9a-8816-601bbf704701 sending to next pipeline
2026-03-25 22:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fcf20b2-5900-5b9a-8816-601bbf704701, identifier: 1982173
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289375d0>
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/4.jpg saved to cache
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fcf20b2-5900-5b9a-8816-601bbf704701 with identifier: 1982173
2026-03-25 22:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fcf20b2-5900-5b9a-8816-601bbf704701 with identifier: 1982173
2026-03-25 22:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1fcf20b2-5900-5b9a-8816-601bbf704701 with identifier: 1982173 to the API
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fcf20b2-5900-5b9a-8816-601bbf704701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 57421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 969309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fcf20b2-5900-5b9a-8816-601bbf704701/1fcf20b2-5900-5b9a-8816-601bbf704701_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xf/103397b1e65347a3a5faa4d51ed41435/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2019}
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982173%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [ayvens.be] INFO: Saving data for 1982173: {'created_time': 1774478749.429022, 'last_price_update_time': 1774478749.429036, 'auction_closing_time': 1775037600.0}
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982173') HTTP/1.1" 204 0
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/4.jpg not downloaded yet
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/5.jpg not downloaded yet
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/6.jpg not downloaded yet
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/7.jpg not downloaded yet
2026-03-25 22:45:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/8.jpg not downloaded yet
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/9.jpg not downloaded yet
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc56d0>
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/7.jpg saved to cache
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/10.jpg not downloaded yet
2026-03-25 22:45:49 [ayvens.be] INFO: Found listing with ID: 1982177
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982177%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [ayvens.be] INFO: Scrape type for 1982177: 1
2026-03-25 22:45:49 [ayvens.be] INFO: Extracting data for car ID: 1982177
2026-03-25 22:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfe83458-af49-529e-b76c-e4973bb0a83a with identifier: 1982177
2026-03-25 22:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe83458-af49-529e-b76c-e4973bb0a83a with scrape type 1
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/1.jpg not downloaded yet
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/2.jpg not downloaded yet
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a21d10>
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/8.jpg saved to cache
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7a2d0>
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/5.jpg saved to cache
2026-03-25 22:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f6fd0>
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/2.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362c090>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/6.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f57d0>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/3.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362c790>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/9.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236efa50>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/9.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/3.jpg not downloaded yet
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/4.jpg not downloaded yet
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/5.jpg not downloaded yet
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/6.jpg not downloaded yet
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/7.jpg not downloaded yet
2026-03-25 22:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/8.jpg not downloaded yet
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/9.jpg not downloaded yet
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/10.jpg not downloaded yet
2026-03-25 22:45:50 [ayvens.be] INFO: Found listing with ID: 1982178
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982178%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [ayvens.be] INFO: Scrape type for 1982178: 1
2026-03-25 22:45:50 [ayvens.be] INFO: Extracting data for car ID: 1982178
2026-03-25 22:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with identifier: 1982178
2026-03-25 22:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with scrape type 1
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/1.jpg not downloaded yet
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21517990>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/4.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28dfae10>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/6.jpg saved to cache
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/2.jpg not downloaded yet
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28775f10>
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/9.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287a74d0>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/7.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cb110>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/10.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b9610>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/1.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287758d0>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/5.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28777a50>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/3.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/3.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/4.jpg not downloaded yet
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/5.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/6.jpg not downloaded yet
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/7.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/8.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/9.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/10.jpg not downloaded yet
2026-03-25 22:45:51 [ayvens.be] INFO: Found listing with ID: 1982179
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982179%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [ayvens.be] INFO: Scrape type for 1982179: 1
2026-03-25 22:45:51 [ayvens.be] INFO: Extracting data for car ID: 1982179
2026-03-25 22:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a738c41-be66-5acf-acdb-af80ab5c94e5 with identifier: 1982179
2026-03-25 22:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a738c41-be66-5acf-acdb-af80ab5c94e5 with scrape type 1
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/1.jpg not downloaded yet
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a07c90>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/3.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1810>
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/1.jpg saved to cache
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/2.jpg not downloaded yet
2026-03-25 22:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/3.jpg not downloaded yet
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42690>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/4.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23641990>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/2.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23648a10>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/2.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23643f50>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/5.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/4.jpg not downloaded yet
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/5.jpg not downloaded yet
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/6.jpg not downloaded yet
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/7.jpg not downloaded yet
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/8.jpg not downloaded yet
2026-03-25 22:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/9.jpg not downloaded yet
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/10.jpg not downloaded yet
2026-03-25 22:45:52 [ayvens.be] INFO: Found listing with ID: 1982180
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982180%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [ayvens.be] INFO: Scrape type for 1982180: 1
2026-03-25 22:45:52 [ayvens.be] INFO: Extracting data for car ID: 1982180
2026-03-25 22:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f5c5b0-5552-5777-823e-899eb20accba with identifier: 1982180
2026-03-25 22:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f5c5b0-5552-5777-823e-899eb20accba with scrape type 1
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/1.jpg not downloaded yet
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/2.jpg not downloaded yet
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa5a50>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/4.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28775f50>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/9.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e41a90>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/1.jpg saved to cache
2026-03-25 22:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccad0>
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/5.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/3.jpg not downloaded yet
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a06a50>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/6.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/4.jpg not downloaded yet
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/5.jpg not downloaded yet
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236da550>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/10.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/6.jpg not downloaded yet
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/7.jpg not downloaded yet
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/8.jpg not downloaded yet
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/9.jpg not downloaded yet
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/10.jpg not downloaded yet
2026-03-25 22:45:53 [ayvens.be] INFO: Found listing with ID: 1982181
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982181%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [ayvens.be] INFO: Scrape type for 1982181: 1
2026-03-25 22:45:53 [ayvens.be] INFO: Extracting data for car ID: 1982181
2026-03-25 22:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de2debce-b59d-5c3b-9e5b-271302e23a49 with identifier: 1982181
2026-03-25 22:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de2debce-b59d-5c3b-9e5b-271302e23a49 with scrape type 1
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/1.jpg not downloaded yet
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/2.jpg not downloaded yet
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a53bd0>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/5.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/3.jpg not downloaded yet
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289342d0>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/8.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21527110>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/2.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/4.jpg not downloaded yet
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/5.jpg not downloaded yet
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e0750>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/6.jpg saved to cache
2026-03-25 22:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890cc50>
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/3.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b4850>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/4.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/6.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/7.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/8.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/9.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/10.jpg not downloaded yet
2026-03-25 22:45:54 [ayvens.be] INFO: Found listing with ID: 1982182
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982182%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [ayvens.be] INFO: Scrape type for 1982182: 1
2026-03-25 22:45:54 [ayvens.be] INFO: Extracting data for car ID: 1982182
2026-03-25 22:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29fd8c7-6c7e-5989-b365-4cc19d106723 with identifier: 1982182
2026-03-25 22:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29fd8c7-6c7e-5989-b365-4cc19d106723 with scrape type 1
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/1.jpg not downloaded yet
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/2.jpg not downloaded yet
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e1990>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/3.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363f510>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/1.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151acd0>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/5.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9250>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/10.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363ef90>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/4.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/3.jpg not downloaded yet
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236edb50>
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/6.jpg saved to cache
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/4.jpg not downloaded yet
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/5.jpg not downloaded yet
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/6.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/7.jpg not downloaded yet
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/8.jpg not downloaded yet
2026-03-25 22:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/9.jpg not downloaded yet
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/10.jpg not downloaded yet
2026-03-25 22:45:54 [ayvens.be] INFO: Found listing with ID: 1982183
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982183%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [ayvens.be] INFO: Scrape type for 1982183: 1
2026-03-25 22:45:55 [ayvens.be] INFO: Extracting data for car ID: 1982183
2026-03-25 22:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 571a6f12-7561-5f91-ab27-6e3d36589c28 with identifier: 1982183
2026-03-25 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 571a6f12-7561-5f91-ab27-6e3d36589c28 with scrape type 1
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/1.jpg not downloaded yet
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/2.jpg not downloaded yet
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28775010>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/5.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64f110>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/7.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a19fd0>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/4.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/3.jpg not downloaded yet
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/4.jpg not downloaded yet
2026-03-25 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/5.jpg not downloaded yet
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a18910>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/8.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/6.jpg not downloaded yet
2026-03-25 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/7.jpg not downloaded yet
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e32d0>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/2.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/8.jpg not downloaded yet
2026-03-25 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/9.jpg not downloaded yet
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/10.jpg not downloaded yet
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c35d0>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/3.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:55 [ayvens.be] INFO: Found listing with ID: 1982184
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982184%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [ayvens.be] INFO: Scrape type for 1982184: 1
2026-03-25 22:45:55 [ayvens.be] INFO: Extracting data for car ID: 1982184
2026-03-25 22:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d722ae-23bd-5dd0-a97a-a1342013ba0e with identifier: 1982184
2026-03-25 22:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e with scrape type 1
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/1.jpg not downloaded yet
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/2.jpg not downloaded yet
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215153d0>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/5.jpg saved to cache
2026-03-25 22:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883ca10>
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/6.jpg saved to cache
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/3.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/4.jpg not downloaded yet
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/5.jpg not downloaded yet
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/6.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/7.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/8.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/9.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/10.jpg not downloaded yet
2026-03-25 22:45:56 [ayvens.be] INFO: Found listing with ID: 1982185
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982185%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [ayvens.be] INFO: Scrape type for 1982185: 1
2026-03-25 22:45:56 [ayvens.be] INFO: Extracting data for car ID: 1982185
2026-03-25 22:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de731b42-2069-5e3b-aae1-2fe285443964 with identifier: 1982185
2026-03-25 22:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de731b42-2069-5e3b-aae1-2fe285443964 with scrape type 1
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/1.jpg not downloaded yet
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603810>
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/7.jpg saved to cache
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6df10>
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/8.jpg saved to cache
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215242d0>
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/4.jpg saved to cache
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28afbb50>
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/3.jpg saved to cache
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/2.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/3.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/4.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/5.jpg not downloaded yet
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/6.jpg not downloaded yet
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/7.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/8.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/9.jpg not downloaded yet
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/10.jpg not downloaded yet
2026-03-25 22:45:56 [ayvens.be] INFO: Found listing with ID: 1982186
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982186%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [ayvens.be] INFO: Scrape type for 1982186: 1
2026-03-25 22:45:56 [ayvens.be] INFO: Extracting data for car ID: 1982186
2026-03-25 22:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad8794a1-a37b-591c-be08-fbea5ee690fc with identifier: 1982186
2026-03-25 22:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8794a1-a37b-591c-be08-fbea5ee690fc with scrape type 1
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/1.jpg not downloaded yet
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28afaf50>
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/7.jpg saved to cache
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287a6110>
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/7.jpg saved to cache
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/2.jpg not downloaded yet
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e850>
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/6.jpg saved to cache
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23654810>
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/5.jpg saved to cache
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809410>
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/4.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/3.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/4.jpg not downloaded yet
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/5.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/6.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/7.jpg not downloaded yet
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/8.jpg not downloaded yet
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/9.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/10.jpg not downloaded yet
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839f110>
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/5.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:45:58 [ayvens.be] INFO: Found listing with ID: 1982187
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982187%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [ayvens.be] INFO: Scrape type for 1982187: 1
2026-03-25 22:45:58 [ayvens.be] INFO: Extracting data for car ID: 1982187
2026-03-25 22:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with identifier: 1982187
2026-03-25 22:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with scrape type 1
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/1.jpg not downloaded yet
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd7d0>
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/4.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150d350>
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/7.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/2.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/3.jpg not downloaded yet
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28937150>
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/4.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21524390>
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/8.jpg saved to cache
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/4.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/5.jpg not downloaded yet
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/6.jpg not downloaded yet
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/7.jpg not downloaded yet
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/8.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/9.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/10.jpg not downloaded yet
2026-03-25 22:45:59 [ayvens.be] INFO: Found listing with ID: 1982188
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982188%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [ayvens.be] INFO: Scrape type for 1982188: 1
2026-03-25 22:45:59 [ayvens.be] INFO: Extracting data for car ID: 1982188
2026-03-25 22:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with identifier: 1982188
2026-03-25 22:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with scrape type 1
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/1.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/2.jpg not downloaded yet
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28819c10>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/5.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a18290>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/3.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b56d0>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/2.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9a0d0>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/3.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fb750>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/4.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/3.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/4.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/5.jpg not downloaded yet
2026-03-25 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/6.jpg not downloaded yet
2026-03-25 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/7.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/8.jpg not downloaded yet
2026-03-25 22:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/9.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/10.jpg not downloaded yet
2026-03-25 22:45:59 [ayvens.be] INFO: Found listing with ID: 1982189
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982189%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [ayvens.be] INFO: Scrape type for 1982189: 1
2026-03-25 22:45:59 [ayvens.be] INFO: Extracting data for car ID: 1982189
2026-03-25 22:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with identifier: 1982189
2026-03-25 22:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with scrape type 1
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/1.jpg not downloaded yet
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/2.jpg not downloaded yet
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f9b50>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/6.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b4d50>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/5.jpg saved to cache
2026-03-25 22:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283aafd0>
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:45:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:45:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/4.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236031d0>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/2.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/3.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/4.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/5.jpg not downloaded yet
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e41cd0>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/3.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/6.jpg not downloaded yet
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/7.jpg not downloaded yet
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/8.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/9.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/10.jpg not downloaded yet
2026-03-25 22:46:00 [ayvens.be] INFO: Found listing with ID: 1982190
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982190%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [ayvens.be] INFO: Scrape type for 1982190: 1
2026-03-25 22:46:00 [ayvens.be] INFO: Extracting data for car ID: 1982190
2026-03-25 22:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4ca93c-3b96-533a-84ee-159208cb363a with identifier: 1982190
2026-03-25 22:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4ca93c-3b96-533a-84ee-159208cb363a with scrape type 1
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/1.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/2.jpg not downloaded yet
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23644210>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/7.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a21c10>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/5.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bcba10>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/2.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b3d50>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/4.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23640950>
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/6.jpg saved to cache
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/3.jpg not downloaded yet
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/4.jpg not downloaded yet
2026-03-25 22:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/5.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/6.jpg not downloaded yet
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/7.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/8.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/9.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/10.jpg not downloaded yet
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b28d0>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/2.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:46:01 [ayvens.be] INFO: Found listing with ID: 1982191
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982191%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [ayvens.be] INFO: Scrape type for 1982191: 1
2026-03-25 22:46:01 [ayvens.be] INFO: Extracting data for car ID: 1982191
2026-03-25 22:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with identifier: 1982191
2026-03-25 22:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with scrape type 1
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/1.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/2.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/3.jpg not downloaded yet
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288d8b90>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/3.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0e350>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/5.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a19a50>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/4.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839e350>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/6.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/4.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/5.jpg not downloaded yet
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/6.jpg not downloaded yet
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/7.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/8.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/9.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/10.jpg not downloaded yet
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603610>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/3.jpg saved to cache
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:46:01 [ayvens.be] INFO: Found listing with ID: 1982192
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982192%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [ayvens.be] INFO: Scrape type for 1982192: 1
2026-03-25 22:46:01 [ayvens.be] INFO: Extracting data for car ID: 1982192
2026-03-25 22:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f30b5fb-4daa-5c2e-b257-385432dd968f with identifier: 1982192
2026-03-25 22:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f30b5fb-4daa-5c2e-b257-385432dd968f with scrape type 1
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/1.jpg not downloaded yet
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/2.jpg not downloaded yet
2026-03-25 22:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/3.jpg not downloaded yet
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367ea90>
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/7.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28934dd0>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/6.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1a50>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/5.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e40b50>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/6.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/4.jpg not downloaded yet
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/5.jpg not downloaded yet
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879b490>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/4.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/6.jpg not downloaded yet
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/7.jpg not downloaded yet
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/8.jpg not downloaded yet
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2110>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/4.jpg saved to cache
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/9.jpg not downloaded yet
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/10.jpg not downloaded yet
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fde90>
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/5.jpg saved to cache
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362e550>
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/3.jpg saved to cache
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289344d0>
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/3.jpg saved to cache
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fcd50>
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/7.jpg saved to cache
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:46:03 [ayvens.be] INFO: Found listing with ID: 1982193
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982193%27 HTTP/1.1" 200 None
2026-03-25 22:46:03 [ayvens.be] INFO: Scrape type for 1982193: 1
2026-03-25 22:46:03 [ayvens.be] INFO: Extracting data for car ID: 1982193
2026-03-25 22:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c8089d-d82a-5903-9a02-919379a24d24 with identifier: 1982193
2026-03-25 22:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c8089d-d82a-5903-9a02-919379a24d24 with scrape type 1
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/1.jpg not downloaded yet
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/2.jpg not downloaded yet
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ce10>
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F0354cfcf331540f3aba657543a9a84b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/8.jpg saved to cache
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cde98efd-c29c-519d-85d5-d6577600352c
2026-03-25 22:46:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cde98efd-c29c-519d-85d5-d6577600352c, skipping ID generation
2026-03-25 22:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde98efd-c29c-519d-85d5-d6577600352c with scrape type 1
2026-03-25 22:46:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cde98efd-c29c-519d-85d5-d6577600352c sending to next pipeline
2026-03-25 22:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cde98efd-c29c-519d-85d5-d6577600352c, identifier: 1982175
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae61d0>
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/6.jpg saved to cache
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236030d0>
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/3.jpg saved to cache
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cde98efd-c29c-519d-85d5-d6577600352c with identifier: 1982175
2026-03-25 22:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cde98efd-c29c-519d-85d5-d6577600352c with identifier: 1982175
2026-03-25 22:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cde98efd-c29c-519d-85d5-d6577600352c with identifier: 1982175 to the API
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cde98efd-c29c-519d-85d5-d6577600352c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 73433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cde98efd-c29c-519d-85d5-d6577600352c/cde98efd-c29c-519d-85d5-d6577600352c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/0354cfcf331540f3aba657543a9a84b6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982175%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [ayvens.be] INFO: Saving data for 1982175: {'created_time': 1774478764.498891, 'last_price_update_time': 1774478764.498902, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982175') HTTP/1.1" 204 0
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/3.jpg not downloaded yet
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/4.jpg not downloaded yet
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/5.jpg not downloaded yet
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/6.jpg not downloaded yet
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/7.jpg not downloaded yet
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/8.jpg not downloaded yet
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/9.jpg not downloaded yet
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/10.jpg not downloaded yet
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d8e90>
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/6.jpg saved to cache
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6fe90>
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/2.jpg saved to cache
2026-03-25 22:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8690>
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/3.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:05 [ayvens.be] INFO: Found listing with ID: 1982194
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982194%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [ayvens.be] INFO: Scrape type for 1982194: 1
2026-03-25 22:46:05 [ayvens.be] INFO: Extracting data for car ID: 1982194
2026-03-25 22:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd2cb845-455c-56dc-81b2-27635e5d6882 with identifier: 1982194
2026-03-25 22:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd2cb845-455c-56dc-81b2-27635e5d6882 with scrape type 1
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/1.jpg not downloaded yet
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/2.jpg not downloaded yet
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac7d50>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/4.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aecd50>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/5.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28934710>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/2.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839d550>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/6.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8c90>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/2.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/3.jpg not downloaded yet
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/4.jpg not downloaded yet
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/5.jpg not downloaded yet
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/6.jpg not downloaded yet
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/7.jpg not downloaded yet
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/8.jpg not downloaded yet
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/9.jpg not downloaded yet
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64cb10>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/4.jpg saved to cache
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/10.jpg not downloaded yet
2026-03-25 22:46:05 [ayvens.be] INFO: Found listing with ID: 1982195
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982195%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [ayvens.be] INFO: Scrape type for 1982195: 1
2026-03-25 22:46:05 [ayvens.be] INFO: Extracting data for car ID: 1982195
2026-03-25 22:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44f9fac4-2c43-5394-97b6-25db1f4cd11e with identifier: 1982195
2026-03-25 22:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e with scrape type 1
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/1.jpg not downloaded yet
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/2.jpg not downloaded yet
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23654510>
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/7.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a354650>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/1.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28740ad0>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/3.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21528a90>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/5.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a363c50>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/6.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741910>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/9.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742c50>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/8.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/3.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/4.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/5.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/6.jpg not downloaded yet
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/7.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/8.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/9.jpg not downloaded yet
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/10.jpg not downloaded yet
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7c110>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/4.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b9110>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/2.jpg saved to cache
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:06 [ayvens.be] INFO: Found listing with ID: 1982196
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982196%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [ayvens.be] INFO: Scrape type for 1982196: 1
2026-03-25 22:46:06 [ayvens.be] INFO: Extracting data for car ID: 1982196
2026-03-25 22:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with identifier: 1982196
2026-03-25 22:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with scrape type 1
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/1.jpg not downloaded yet
2026-03-25 22:46:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 8 pages/min), scraped 7 items (at 7 items/min)
2026-03-25 22:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28396650>
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/1.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a18e10>
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/3.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/2.jpg not downloaded yet
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/3.jpg not downloaded yet
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877d290>
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/5.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac6dd0>
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/9.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8f10>
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F8d5a468fb7bd463fb469be6fc71e8a43%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/10.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f30b5fb-4daa-5c2e-b257-385432dd968f
2026-03-25 22:46:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f30b5fb-4daa-5c2e-b257-385432dd968f, skipping ID generation
2026-03-25 22:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f30b5fb-4daa-5c2e-b257-385432dd968f with scrape type 1
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f30b5fb-4daa-5c2e-b257-385432dd968f sending to next pipeline
2026-03-25 22:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f30b5fb-4daa-5c2e-b257-385432dd968f, identifier: 1982192
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4f490>
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/10.jpg saved to cache
2026-03-25 22:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f30b5fb-4daa-5c2e-b257-385432dd968f with identifier: 1982192
2026-03-25 22:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f30b5fb-4daa-5c2e-b257-385432dd968f with identifier: 1982192
2026-03-25 22:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f30b5fb-4daa-5c2e-b257-385432dd968f with identifier: 1982192 to the API
2026-03-25 22:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '9f30b5fb-4daa-5c2e-b257-385432dd968f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 29197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 963533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f30b5fb-4daa-5c2e-b257-385432dd968f/9f30b5fb-4daa-5c2e-b257-385432dd968f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 956583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/8d5a468fb7bd463fb469be6fc71e8a43/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982192%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [ayvens.be] INFO: Saving data for 1982192: {'created_time': 1774478768.117609, 'last_price_update_time': 1774478768.11762, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982192') HTTP/1.1" 204 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/4.jpg not downloaded yet
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/5.jpg not downloaded yet
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a4e62d0>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/3.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/6.jpg not downloaded yet
2026-03-25 22:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/7.jpg not downloaded yet
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/8.jpg not downloaded yet
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1e9d0>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/4.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aec410>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/2.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/9.jpg not downloaded yet
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/10.jpg not downloaded yet
2026-03-25 22:46:08 [ayvens.be] INFO: Found listing with ID: 1982197
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982197%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [ayvens.be] INFO: Scrape type for 1982197: 1
2026-03-25 22:46:08 [ayvens.be] INFO: Extracting data for car ID: 1982197
2026-03-25 22:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d832a4-cf6d-565d-b848-b9142d49d51c with identifier: 1982197
2026-03-25 22:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d832a4-cf6d-565d-b848-b9142d49d51c with scrape type 1
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/1.jpg not downloaded yet
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a54d0>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/2.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283949d0>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/1.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ce950>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/5.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa63d0>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/1.jpg saved to cache
2026-03-25 22:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b08610>
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/8.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/2.jpg not downloaded yet
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/3.jpg not downloaded yet
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/4.jpg not downloaded yet
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/5.jpg not downloaded yet
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/6.jpg not downloaded yet
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/7.jpg not downloaded yet
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cf3d0>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/5.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1d50>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/1.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f7b10>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/3.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e710>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/4.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/8.jpg not downloaded yet
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924d10>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/10.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21511750>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/9.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815a50>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/10.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669b10>
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/8.jpg saved to cache
2026-03-25 22:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/9.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/10.jpg not downloaded yet
2026-03-25 22:46:10 [ayvens.be] INFO: Found listing with ID: 1982198
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982198%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [ayvens.be] INFO: Scrape type for 1982198: 1
2026-03-25 22:46:10 [ayvens.be] INFO: Extracting data for car ID: 1982198
2026-03-25 22:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with identifier: 1982198
2026-03-25 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with scrape type 1
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/1.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/2.jpg not downloaded yet
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/3.jpg not downloaded yet
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/4.jpg not downloaded yet
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/5.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/6.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/7.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/8.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/9.jpg not downloaded yet
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d47d0>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/4.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361fd10>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/5.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bf410>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/3.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892f290>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/2.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ba90d0>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/6.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b6f10>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/8.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/10.jpg not downloaded yet
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367e990>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/7.jpg saved to cache
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:10 [ayvens.be] INFO: Found listing with ID: 1982199
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982199%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [ayvens.be] INFO: Scrape type for 1982199: 1
2026-03-25 22:46:10 [ayvens.be] INFO: Extracting data for car ID: 1982199
2026-03-25 22:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f4678f6-413e-5f1d-af94-034bf9face0e with identifier: 1982199
2026-03-25 22:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f4678f6-413e-5f1d-af94-034bf9face0e with scrape type 1
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/1.jpg not downloaded yet
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/2.jpg not downloaded yet
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1ce10>
2026-03-25 22:46:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/9.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/3.jpg not downloaded yet
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/4.jpg not downloaded yet
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0df90>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/1.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/5.jpg not downloaded yet
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/6.jpg not downloaded yet
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/7.jpg not downloaded yet
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817890>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/9.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f0690>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/3.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289359d0>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/7.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/8.jpg not downloaded yet
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/9.jpg not downloaded yet
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa6710>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/2.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362db50>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/10.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1cd50>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/8.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742b10>
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/8.jpg saved to cache
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/10.jpg not downloaded yet
2026-03-25 22:46:12 [ayvens.be] INFO: Found listing with ID: 1982200
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982200%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [ayvens.be] INFO: Scrape type for 1982200: 1
2026-03-25 22:46:12 [ayvens.be] INFO: Extracting data for car ID: 1982200
2026-03-25 22:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ab326d-e2f5-507b-9135-99e0ac9492c2 with identifier: 1982200
2026-03-25 22:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ab326d-e2f5-507b-9135-99e0ac9492c2 with scrape type 1
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/1.jpg not downloaded yet
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/2.jpg not downloaded yet
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288da650>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/1.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/3.jpg not downloaded yet
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/4.jpg not downloaded yet
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151bb50>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/9.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/5.jpg not downloaded yet
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/6.jpg not downloaded yet
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/7.jpg not downloaded yet
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742b10>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/5.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799f50>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/2.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917310>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/6.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289262d0>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/10.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/8.jpg not downloaded yet
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/9.jpg not downloaded yet
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150f550>
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252Fa0948fef2857490caec1df9eee5e8fe9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/4.jpg saved to cache
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62d832a4-cf6d-565d-b848-b9142d49d51c
2026-03-25 22:46:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62d832a4-cf6d-565d-b848-b9142d49d51c, skipping ID generation
2026-03-25 22:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d832a4-cf6d-565d-b848-b9142d49d51c with scrape type 1
2026-03-25 22:46:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62d832a4-cf6d-565d-b848-b9142d49d51c sending to next pipeline
2026-03-25 22:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62d832a4-cf6d-565d-b848-b9142d49d51c, identifier: 1982197
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c8090>
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/9.jpg saved to cache
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/10.jpg not downloaded yet
2026-03-25 22:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62d832a4-cf6d-565d-b848-b9142d49d51c with identifier: 1982197
2026-03-25 22:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62d832a4-cf6d-565d-b848-b9142d49d51c with identifier: 1982197
2026-03-25 22:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62d832a4-cf6d-565d-b848-b9142d49d51c with identifier: 1982197 to the API
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '62d832a4-cf6d-565d-b848-b9142d49d51c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 32161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 845021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62d832a4-cf6d-565d-b848-b9142d49d51c/62d832a4-cf6d-565d-b848-b9142d49d51c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/a0948fef2857490caec1df9eee5e8fe9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982197%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [ayvens.be] INFO: Saving data for 1982197: {'created_time': 1774478773.625711, 'last_price_update_time': 1774478773.625721, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982197') HTTP/1.1" 204 0
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [ayvens.be] INFO: Found listing with ID: 1982201
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982201%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [ayvens.be] INFO: Scrape type for 1982201: 1
2026-03-25 22:46:13 [ayvens.be] INFO: Extracting data for car ID: 1982201
2026-03-25 22:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee80ac1a-758d-5fd7-aa2c-383a26dd401c with identifier: 1982201
2026-03-25 22:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c with scrape type 1
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/1.jpg not downloaded yet
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/2.jpg not downloaded yet
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f16d0>
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/10.jpg saved to cache
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/3.jpg not downloaded yet
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/4.jpg not downloaded yet
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f8b90>
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/4.jpg saved to cache
2026-03-25 22:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2abf8090>
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/1.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150a890>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/3.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cfbd0>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/5.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/5.jpg not downloaded yet
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/6.jpg not downloaded yet
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/7.jpg not downloaded yet
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215099d0>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/2.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2d910>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/7.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/8.jpg not downloaded yet
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/9.jpg not downloaded yet
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514d50>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/6.jpg saved to cache
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/10.jpg not downloaded yet
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:14 [ayvens.be] INFO: Found listing with ID: 1982202
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982202%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [ayvens.be] INFO: Scrape type for 1982202: 1
2026-03-25 22:46:14 [ayvens.be] INFO: Extracting data for car ID: 1982202
2026-03-25 22:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with identifier: 1982202
2026-03-25 22:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with scrape type 1
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/1.jpg not downloaded yet
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/2.jpg not downloaded yet
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289259d0>
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/8.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814ad0>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/10.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a50b50>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/2.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6c4d0>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/1.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/3.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c1050>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/3.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878aa50>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/4.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21519a10>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/9.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/4.jpg not downloaded yet
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/5.jpg not downloaded yet
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b050>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/6.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/6.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/7.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/8.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/9.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/10.jpg not downloaded yet
2026-03-25 22:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:15 [ayvens.be] INFO: Found listing with ID: 1982203
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982203%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [ayvens.be] INFO: Scrape type for 1982203: 1
2026-03-25 22:46:15 [ayvens.be] INFO: Extracting data for car ID: 1982203
2026-03-25 22:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ccd013d-946a-560d-bafa-adc9ed1a65ba with identifier: 1982203
2026-03-25 22:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba with scrape type 1
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/1.jpg not downloaded yet
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/2.jpg not downloaded yet
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21528dd0>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/9.jpg saved to cache
2026-03-25 22:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516a10>
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/7.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa4710>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/2.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fd9d0>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/5.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff4890>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/1.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/3.jpg not downloaded yet
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814a10>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/8.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/4.jpg not downloaded yet
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/5.jpg not downloaded yet
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917c10>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F688476fff4984f22b16fafb51603a186%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/10.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69ab326d-e2f5-507b-9135-99e0ac9492c2
2026-03-25 22:46:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69ab326d-e2f5-507b-9135-99e0ac9492c2, skipping ID generation
2026-03-25 22:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ab326d-e2f5-507b-9135-99e0ac9492c2 with scrape type 1
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69ab326d-e2f5-507b-9135-99e0ac9492c2 sending to next pipeline
2026-03-25 22:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69ab326d-e2f5-507b-9135-99e0ac9492c2, identifier: 1982200
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f1890>
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/4.jpg saved to cache
2026-03-25 22:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69ab326d-e2f5-507b-9135-99e0ac9492c2 with identifier: 1982200
2026-03-25 22:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69ab326d-e2f5-507b-9135-99e0ac9492c2 with identifier: 1982200
2026-03-25 22:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69ab326d-e2f5-507b-9135-99e0ac9492c2 with identifier: 1982200 to the API
2026-03-25 22:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '69ab326d-e2f5-507b-9135-99e0ac9492c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 42451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69ab326d-e2f5-507b-9135-99e0ac9492c2/69ab326d-e2f5-507b-9135-99e0ac9492c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 942923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/688476fff4984f22b16fafb51603a186/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982200%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [ayvens.be] INFO: Saving data for 1982200: {'created_time': 1774478777.170154, 'last_price_update_time': 1774478777.170164, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982200') HTTP/1.1" 204 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/6.jpg not downloaded yet
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/7.jpg not downloaded yet
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/8.jpg not downloaded yet
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/9.jpg not downloaded yet
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/10.jpg not downloaded yet
2026-03-25 22:46:17 [ayvens.be] INFO: Found listing with ID: 1982204
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982204%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [ayvens.be] INFO: Scrape type for 1982204: 1
2026-03-25 22:46:17 [ayvens.be] INFO: Extracting data for car ID: 1982204
2026-03-25 22:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4991c624-906d-5f9d-a369-cb66974f815b with identifier: 1982204
2026-03-25 22:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4991c624-906d-5f9d-a369-cb66974f815b with scrape type 1
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/1.jpg not downloaded yet
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e23d0>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/5.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a05ad0>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/7.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ae50>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/3.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23691d50>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/1.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848650>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/2.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a646450>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/6.jpg saved to cache
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/2.jpg not downloaded yet
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee2d0>
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/8.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28776210>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/10.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/3.jpg not downloaded yet
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/4.jpg not downloaded yet
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/5.jpg not downloaded yet
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/6.jpg not downloaded yet
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/7.jpg not downloaded yet
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/8.jpg not downloaded yet
2026-03-25 22:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/9.jpg not downloaded yet
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/10.jpg not downloaded yet
2026-03-25 22:46:18 [ayvens.be] INFO: Found listing with ID: 1982205
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982205%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [ayvens.be] INFO: Scrape type for 1982205: 1
2026-03-25 22:46:18 [ayvens.be] INFO: Extracting data for car ID: 1982205
2026-03-25 22:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a659f7-eb95-5bd0-8750-c7463129a097 with identifier: 1982205
2026-03-25 22:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a659f7-eb95-5bd0-8750-c7463129a097 with scrape type 1
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/1.jpg not downloaded yet
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/2.jpg not downloaded yet
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e8bd0>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/3.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b79a10>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/6.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876e990>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/7.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae5390>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/2.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7dfd0>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/5.jpg saved to cache
2026-03-25 22:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff7850>
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/4.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/3.jpg not downloaded yet
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/4.jpg not downloaded yet
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd250>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/9.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9410>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/8.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/5.jpg not downloaded yet
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/6.jpg not downloaded yet
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/7.jpg not downloaded yet
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/8.jpg not downloaded yet
2026-03-25 22:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/9.jpg not downloaded yet
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/10.jpg not downloaded yet
2026-03-25 22:46:19 [ayvens.be] INFO: Found listing with ID: 1982206
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982206%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [ayvens.be] INFO: Scrape type for 1982206: 1
2026-03-25 22:46:19 [ayvens.be] INFO: Extracting data for car ID: 1982206
2026-03-25 22:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a7832d-e38a-5e79-a590-d21086305cb7 with identifier: 1982206
2026-03-25 22:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a7832d-e38a-5e79-a590-d21086305cb7 with scrape type 1
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/1.jpg not downloaded yet
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c9810>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/5.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/2.jpg not downloaded yet
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b56d0>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/7.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a354410>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/2.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23692ed0>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/6.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151a850>
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/1.jpg saved to cache
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/3.jpg not downloaded yet
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/4.jpg not downloaded yet
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9650>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/1.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b8590>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/4.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924950>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/8.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/5.jpg not downloaded yet
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/6.jpg not downloaded yet
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/7.jpg not downloaded yet
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/8.jpg not downloaded yet
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/9.jpg not downloaded yet
2026-03-25 22:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/10.jpg not downloaded yet
2026-03-25 22:46:20 [ayvens.be] INFO: Found listing with ID: 1982207
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982207%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [ayvens.be] INFO: Scrape type for 1982207: 1
2026-03-25 22:46:20 [ayvens.be] INFO: Extracting data for car ID: 1982207
2026-03-25 22:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with identifier: 1982207
2026-03-25 22:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with scrape type 1
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/1.jpg not downloaded yet
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/2.jpg not downloaded yet
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7f550>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/3.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369e410>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/2.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879a910>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/3.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bca090>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/4.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825110>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/5.jpg saved to cache
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/3.jpg not downloaded yet
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917e50>
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/6.jpg saved to cache
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/4.jpg not downloaded yet
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/5.jpg not downloaded yet
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28831010>
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/9.jpg saved to cache
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799d50>
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0321f7ed6cdb42f3a654f37fadfb514d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/10.jpg saved to cache
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba
2026-03-25 22:46:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ccd013d-946a-560d-bafa-adc9ed1a65ba, skipping ID generation
2026-03-25 22:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba with scrape type 1
2026-03-25 22:46:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ccd013d-946a-560d-bafa-adc9ed1a65ba sending to next pipeline
2026-03-25 22:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ccd013d-946a-560d-bafa-adc9ed1a65ba, identifier: 1982203
2026-03-25 22:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ccd013d-946a-560d-bafa-adc9ed1a65ba with identifier: 1982203
2026-03-25 22:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ccd013d-946a-560d-bafa-adc9ed1a65ba with identifier: 1982203
2026-03-25 22:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ccd013d-946a-560d-bafa-adc9ed1a65ba with identifier: 1982203 to the API
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '1ccd013d-946a-560d-bafa-adc9ed1a65ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 89991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 917090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ccd013d-946a-560d-bafa-adc9ed1a65ba/1ccd013d-946a-560d-bafa-adc9ed1a65ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 942283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0321f7ed6cdb42f3a654f37fadfb514d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982203%27 HTTP/1.1" 200 None
2026-03-25 22:46:21 [ayvens.be] INFO: Saving data for 1982203: {'created_time': 1774478781.964953, 'last_price_update_time': 1774478781.964962, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982203') HTTP/1.1" 204 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/6.jpg not downloaded yet
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/7.jpg not downloaded yet
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/8.jpg not downloaded yet
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/9.jpg not downloaded yet
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/10.jpg not downloaded yet
2026-03-25 22:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:22 [ayvens.be] INFO: Found listing with ID: 1982208
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982208%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [ayvens.be] INFO: Scrape type for 1982208: 1
2026-03-25 22:46:22 [ayvens.be] INFO: Extracting data for car ID: 1982208
2026-03-25 22:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a2e055-7986-59c1-a734-6c51a6713b2b with identifier: 1982208
2026-03-25 22:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a2e055-7986-59c1-a734-6c51a6713b2b with scrape type 1
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/1.jpg not downloaded yet
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/2.jpg not downloaded yet
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883d090>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/5.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/3.jpg not downloaded yet
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883e6d0>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/6.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514d90>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/4.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236438d0>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/1.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288184d0>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/3.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/4.jpg not downloaded yet
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/5.jpg not downloaded yet
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d5290>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/7.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901edd0>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/9.jpg saved to cache
2026-03-25 22:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877d890>
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/10.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/6.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/7.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/8.jpg not downloaded yet
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/9.jpg not downloaded yet
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/10.jpg not downloaded yet
2026-03-25 22:46:23 [ayvens.be] INFO: Found listing with ID: 1982329
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982329%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [ayvens.be] INFO: Scrape type for 1982329: 1
2026-03-25 22:46:23 [ayvens.be] INFO: Extracting data for car ID: 1982329
2026-03-25 22:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-25 22:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88032add-a537-5e53-ada9-4a19d9dc69ef with scrape type 1
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/1.jpg not downloaded yet
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/2.jpg not downloaded yet
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28849d90>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/5.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283aae10>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/2.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fe690>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/4.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e7ed0>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/1.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/3.jpg not downloaded yet
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603910>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/2.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccd50>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/6.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4190>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/3.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4d50>
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/7.jpg saved to cache
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/4.jpg not downloaded yet
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/5.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/6.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/7.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/8.jpg not downloaded yet
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/9.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/10.jpg not downloaded yet
2026-03-25 22:46:24 [ayvens.be] INFO: Found listing with ID: 1982330
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982330%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [ayvens.be] INFO: Scrape type for 1982330: 1
2026-03-25 22:46:24 [ayvens.be] INFO: Extracting data for car ID: 1982330
2026-03-25 22:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-25 22:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d264e6-64ee-5681-a2e2-b5c058193019 with scrape type 1
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/1.jpg not downloaded yet
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7f410>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/7.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/2.jpg not downloaded yet
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236031d0>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/5.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1b7d0>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/3.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e3a50>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/4.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917f10>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/1.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925650>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/4.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28793550>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/6.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28394b90>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/10.jpg saved to cache
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/3.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/4.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/5.jpg not downloaded yet
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/6.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/7.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/8.jpg not downloaded yet
2026-03-25 22:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/9.jpg not downloaded yet
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ed10>
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/3.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369d650>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/2.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901f810>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/1.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/10.jpg not downloaded yet
2026-03-25 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:25 [ayvens.be] INFO: Found listing with ID: 1982331
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982331%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [ayvens.be] INFO: Scrape type for 1982331: 1
2026-03-25 22:46:25 [ayvens.be] INFO: Extracting data for car ID: 1982331
2026-03-25 22:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-25 22:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with scrape type 1
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/1.jpg not downloaded yet
2026-03-25 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/2.jpg not downloaded yet
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a5e10>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/5.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f42d0>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/1.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766690>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/2.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b35d0>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/6.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e3390>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/10.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/3.jpg not downloaded yet
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364ad10>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/6.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/4.jpg not downloaded yet
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9850>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/5.jpg saved to cache
2026-03-25 22:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23611190>
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/7.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/5.jpg not downloaded yet
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a84a950>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/4.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28936510>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/8.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/6.jpg not downloaded yet
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/7.jpg not downloaded yet
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/8.jpg not downloaded yet
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/9.jpg not downloaded yet
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/10.jpg not downloaded yet
2026-03-25 22:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:26 [ayvens.be] INFO: Found listing with ID: 1982332
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982332%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [ayvens.be] INFO: Scrape type for 1982332: 1
2026-03-25 22:46:26 [ayvens.be] INFO: Extracting data for car ID: 1982332
2026-03-25 22:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-25 22:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ab8f8c-f600-567b-bdfe-38251527bb98 with scrape type 1
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/1.jpg not downloaded yet
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/2.jpg not downloaded yet
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21509050>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/3.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924f50>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/8.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627b10>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/2.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28927ed0>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/9.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150b690>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/10.jpg saved to cache
2026-03-25 22:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925490>
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/1.jpg saved to cache
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f250>
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/4.jpg saved to cache
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/3.jpg not downloaded yet
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a354d90>
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/5.jpg saved to cache
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/4.jpg not downloaded yet
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/5.jpg not downloaded yet
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/6.jpg not downloaded yet
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/7.jpg not downloaded yet
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/8.jpg not downloaded yet
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/9.jpg not downloaded yet
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/10.jpg not downloaded yet
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b7250>
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8c328cc48f7647a5b284d882fef630d6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/9.jpg saved to cache
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88032add-a537-5e53-ada9-4a19d9dc69ef
2026-03-25 22:46:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88032add-a537-5e53-ada9-4a19d9dc69ef, skipping ID generation
2026-03-25 22:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88032add-a537-5e53-ada9-4a19d9dc69ef with scrape type 1
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88032add-a537-5e53-ada9-4a19d9dc69ef sending to next pipeline
2026-03-25 22:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 88032add-a537-5e53-ada9-4a19d9dc69ef, identifier: 1982329
2026-03-25 22:46:27 [ayvens.be] INFO: Found listing with ID: 1982333
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982333%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [ayvens.be] INFO: Scrape type for 1982333: 1
2026-03-25 22:46:27 [ayvens.be] INFO: Extracting data for car ID: 1982333
2026-03-25 22:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-25 22:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27e9242-9738-549f-a594-37d64626cefe with scrape type 1
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/1.jpg not downloaded yet
2026-03-25 22:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-25 22:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329
2026-03-25 22:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 88032add-a537-5e53-ada9-4a19d9dc69ef with identifier: 1982329 to the API
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '88032add-a537-5e53-ada9-4a19d9dc69ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 33237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88032add-a537-5e53-ada9-4a19d9dc69ef/88032add-a537-5e53-ada9-4a19d9dc69ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8c328cc48f7647a5b284d882fef630d6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982329%27 HTTP/1.1" 200 None
2026-03-25 22:46:28 [ayvens.be] INFO: Saving data for 1982329: {'created_time': 1774478788.26907, 'last_price_update_time': 1774478788.269081, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982329') HTTP/1.1" 204 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/2.jpg not downloaded yet
2026-03-25 22:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901de90>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/2.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367fbd0>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/6.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287a4850>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/8.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236928d0>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/1.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901de90>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/7.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f8bd0>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/9.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287a6490>
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F775f0065d2014a1bb15aa3c44e3c1f09%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/10.jpg saved to cache
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3d264e6-64ee-5681-a2e2-b5c058193019
2026-03-25 22:46:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d264e6-64ee-5681-a2e2-b5c058193019, skipping ID generation
2026-03-25 22:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d264e6-64ee-5681-a2e2-b5c058193019 with scrape type 1
2026-03-25 22:46:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d264e6-64ee-5681-a2e2-b5c058193019 sending to next pipeline
2026-03-25 22:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3d264e6-64ee-5681-a2e2-b5c058193019, identifier: 1982330
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/3.jpg not downloaded yet
2026-03-25 22:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-25 22:46:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330
2026-03-25 22:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3d264e6-64ee-5681-a2e2-b5c058193019 with identifier: 1982330 to the API
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLANC NACRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd3d264e6-64ee-5681-a2e2-b5c058193019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008 DIESEL - 2016',
 'odometer': 187463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d264e6-64ee-5681-a2e2-b5c058193019/d3d264e6-64ee-5681-a2e2-b5c058193019_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/775f0065d2014a1bb15aa3c44e3c1f09/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seats_number': None,
 'seller_name': None,
 'title': 'PEUGEOT 3008 DIESEL - 2016 2.0 BlueHDi GT (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi GT (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982330%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [ayvens.be] INFO: Saving data for 1982330: {'created_time': 1774478789.41912, 'last_price_update_time': 1774478789.41913, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982330') HTTP/1.1" 204 0
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/4.jpg not downloaded yet
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7650>
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/6.jpg saved to cache
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/5.jpg not downloaded yet
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/6.jpg not downloaded yet
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/7.jpg not downloaded yet
2026-03-25 22:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/8.jpg not downloaded yet
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/9.jpg not downloaded yet
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/10.jpg not downloaded yet
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881b890>
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/7.jpg saved to cache
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:29 [ayvens.be] INFO: Found listing with ID: 1982334
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982334%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [ayvens.be] INFO: Scrape type for 1982334: 1
2026-03-25 22:46:29 [ayvens.be] INFO: Extracting data for car ID: 1982334
2026-03-25 22:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-25 22:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44bb305-671e-5a96-aed0-8f3645b2ee04 with scrape type 1
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/1.jpg not downloaded yet
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bccd0>
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/5.jpg saved to cache
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/2.jpg not downloaded yet
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/3.jpg not downloaded yet
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc6610>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/4.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288483d0>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/3.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a849f90>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/8.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283ab710>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/2.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0690>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/3.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515a90>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/1.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/4.jpg not downloaded yet
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/5.jpg not downloaded yet
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/6.jpg not downloaded yet
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/7.jpg not downloaded yet
2026-03-25 22:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/8.jpg not downloaded yet
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/9.jpg not downloaded yet
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b8150>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/5.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/10.jpg not downloaded yet
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bb7d0>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/6.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b8a50>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/4.jpg saved to cache
2026-03-25 22:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877ced0>
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/10.jpg saved to cache
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b64d0>
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/3.jpg saved to cache
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:31 [ayvens.be] INFO: Found listing with ID: 1982335
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982335%27 HTTP/1.1" 200 None
2026-03-25 22:46:31 [ayvens.be] INFO: Scrape type for 1982335: 1
2026-03-25 22:46:31 [ayvens.be] INFO: Extracting data for car ID: 1982335
2026-03-25 22:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-25 22:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245d263a-8a9d-5652-900c-eb6ef49b5c65 with scrape type 1
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/1.jpg not downloaded yet
2026-03-25 22:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/2.jpg not downloaded yet
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1710>
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/2.jpg saved to cache
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a06050>
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/7.jpg saved to cache
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892f910>
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fab746f3d590e44a8a2b979bf2a34d728%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/9.jpg saved to cache
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495
2026-03-25 22:46:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a60bbba9-24f5-5fe1-b8e3-c1d495eae495, skipping ID generation
2026-03-25 22:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with scrape type 1
2026-03-25 22:46:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a60bbba9-24f5-5fe1-b8e3-c1d495eae495 sending to next pipeline
2026-03-25 22:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a60bbba9-24f5-5fe1-b8e3-c1d495eae495, identifier: 1982331
2026-03-25 22:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-25 22:46:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331
2026-03-25 22:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a60bbba9-24f5-5fe1-b8e3-c1d495eae495 with identifier: 1982331 to the API
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a60bbba9-24f5-5fe1-b8e3-c1d495eae495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 155312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60bbba9-24f5-5fe1-b8e3-c1d495eae495/a60bbba9-24f5-5fe1-b8e3-c1d495eae495_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ab746f3d590e44a8a2b979bf2a34d728/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 B 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982331%27 HTTP/1.1" 200 None
2026-03-25 22:46:32 [ayvens.be] INFO: Saving data for 1982331: {'created_time': 1774478792.09054, 'last_price_update_time': 1774478792.09055, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982331') HTTP/1.1" 204 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/3.jpg not downloaded yet
2026-03-25 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/4.jpg not downloaded yet
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901c650>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/1.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817b50>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/10.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23640dd0>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/9.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/5.jpg not downloaded yet
2026-03-25 22:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/6.jpg not downloaded yet
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a355a90>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tm%252F36afe0cd98344ea6b77b03092060e0c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/8.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5ab8f8c-f600-567b-bdfe-38251527bb98
2026-03-25 22:46:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ab8f8c-f600-567b-bdfe-38251527bb98, skipping ID generation
2026-03-25 22:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ab8f8c-f600-567b-bdfe-38251527bb98 with scrape type 1
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ab8f8c-f600-567b-bdfe-38251527bb98 sending to next pipeline
2026-03-25 22:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5ab8f8c-f600-567b-bdfe-38251527bb98, identifier: 1982332
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367ec90>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/4.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f1bd0>
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/5.jpg saved to cache
2026-03-25 22:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-25 22:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332
2026-03-25 22:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5ab8f8c-f600-567b-bdfe-38251527bb98 with identifier: 1982332 to the API
2026-03-25 22:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.8L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f5ab8f8c-f600-567b-bdfe-38251527bb98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'LAND CRUISER LWB DIESEL - 2013',
 'odometer': 193258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ab8f8c-f600-567b-bdfe-38251527bb98/f5ab8f8c-f600-567b-bdfe-38251527bb98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tm/36afe0cd98344ea6b77b03092060e0c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA LAND CRUISER LWB DIESEL - 2013 2.8 D-4D Active Van Aut',
 'transmission': 'automatic',
 'trim': '2.8 D-4D Active Van Aut',
 'vin': None,
 'year': 2017}
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982332%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [ayvens.be] INFO: Saving data for 1982332: {'created_time': 1774478793.162967, 'last_price_update_time': 1774478793.162976, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982332') HTTP/1.1" 204 0
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/7.jpg not downloaded yet
2026-03-25 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/8.jpg not downloaded yet
2026-03-25 22:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e950>
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/1.jpg saved to cache
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514390>
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fdf52921bbcfb4c3ebcaae80cab58c0c1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/7.jpg saved to cache
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79a2e055-7986-59c1-a734-6c51a6713b2b
2026-03-25 22:46:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79a2e055-7986-59c1-a734-6c51a6713b2b, skipping ID generation
2026-03-25 22:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a2e055-7986-59c1-a734-6c51a6713b2b with scrape type 1
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a2e055-7986-59c1-a734-6c51a6713b2b sending to next pipeline
2026-03-25 22:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79a2e055-7986-59c1-a734-6c51a6713b2b, identifier: 1982208
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/9.jpg not downloaded yet
2026-03-25 22:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79a2e055-7986-59c1-a734-6c51a6713b2b with identifier: 1982208
2026-03-25 22:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79a2e055-7986-59c1-a734-6c51a6713b2b with identifier: 1982208
2026-03-25 22:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79a2e055-7986-59c1-a734-6c51a6713b2b with identifier: 1982208 to the API
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '79a2e055-7986-59c1-a734-6c51a6713b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 75793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 954184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 921660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a2e055-7986-59c1-a734-6c51a6713b2b/79a2e055-7986-59c1-a734-6c51a6713b2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 956329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/df52921bbcfb4c3ebcaae80cab58c0c1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982208%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [ayvens.be] INFO: Saving data for 1982208: {'created_time': 1774478793.862392, 'last_price_update_time': 1774478793.862403, 'auction_closing_time': 1775037600.0}
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982208') HTTP/1.1" 204 0
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/10.jpg not downloaded yet
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a94c50>
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/3.jpg saved to cache
2026-03-25 22:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289378d0>
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/2.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:34 [ayvens.be] INFO: Found listing with ID: 1982336
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982336%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [ayvens.be] INFO: Scrape type for 1982336: 1
2026-03-25 22:46:34 [ayvens.be] INFO: Extracting data for car ID: 1982336
2026-03-25 22:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-25 22:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with scrape type 1
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/1.jpg not downloaded yet
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/2.jpg not downloaded yet
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/3.jpg not downloaded yet
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/4.jpg not downloaded yet
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/5.jpg not downloaded yet
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/6.jpg not downloaded yet
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/7.jpg not downloaded yet
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369e050>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/4.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ff10>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/10.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa0c90>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/6.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/8.jpg not downloaded yet
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881f690>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/7.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366a510>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/9.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/9.jpg not downloaded yet
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/10.jpg not downloaded yet
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a394d50>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/1.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288aef90>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/8.jpg saved to cache
2026-03-25 22:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4150>
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/10.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [ayvens.be] INFO: Found listing with ID: 1982337
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982337%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [ayvens.be] INFO: Scrape type for 1982337: 1
2026-03-25 22:46:35 [ayvens.be] INFO: Extracting data for car ID: 1982337
2026-03-25 22:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-25 22:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf with scrape type 1
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/1.jpg not downloaded yet
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/2.jpg not downloaded yet
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/3.jpg not downloaded yet
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/4.jpg not downloaded yet
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/5.jpg not downloaded yet
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288aca50>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/5.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/6.jpg not downloaded yet
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/7.jpg not downloaded yet
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/8.jpg not downloaded yet
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e3a10>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/8.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892e850>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/3.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880af90>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/9.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7f350>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/6.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809dd0>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/7.jpg saved to cache
2026-03-25 22:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741990>
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/4.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28808090>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/2.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/9.jpg not downloaded yet
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/10.jpg not downloaded yet
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [ayvens.be] INFO: Found listing with ID: 1982338
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982338%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [ayvens.be] INFO: Scrape type for 1982338: 1
2026-03-25 22:46:36 [ayvens.be] INFO: Extracting data for car ID: 1982338
2026-03-25 22:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-25 22:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17b7144-1840-536d-9e87-64ba56072f21 with scrape type 1
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/1.jpg not downloaded yet
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/2.jpg not downloaded yet
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/3.jpg not downloaded yet
2026-03-25 22:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/4.jpg not downloaded yet
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cca50>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/9.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/5.jpg not downloaded yet
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/6.jpg not downloaded yet
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1ed50>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/7.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2c90>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/8.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ae890>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/2.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ad1490>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/8.jpg saved to cache
2026-03-25 22:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28937e10>
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/7.jpg saved to cache
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839dc90>
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fbc469638a0fe4a9ca50d3cec635291ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/10.jpg saved to cache
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 245d263a-8a9d-5652-900c-eb6ef49b5c65
2026-03-25 22:46:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 245d263a-8a9d-5652-900c-eb6ef49b5c65, skipping ID generation
2026-03-25 22:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245d263a-8a9d-5652-900c-eb6ef49b5c65 with scrape type 1
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 245d263a-8a9d-5652-900c-eb6ef49b5c65 sending to next pipeline
2026-03-25 22:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 245d263a-8a9d-5652-900c-eb6ef49b5c65, identifier: 1982335
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688990>
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/1.jpg saved to cache
2026-03-25 22:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-25 22:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335
2026-03-25 22:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 245d263a-8a9d-5652-900c-eb6ef49b5c65 with identifier: 1982335 to the API
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '245d263a-8a9d-5652-900c-eb6ef49b5c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 160268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_245d263a-8a9d-5652-900c-eb6ef49b5c65/245d263a-8a9d-5652-900c-eb6ef49b5c65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/bc469638a0fe4a9ca50d3cec635291ef/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982335%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [ayvens.be] INFO: Saving data for 1982335: {'created_time': 1774478798.085271, 'last_price_update_time': 1774478798.085281, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982335') HTTP/1.1" 204 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/7.jpg not downloaded yet
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/8.jpg not downloaded yet
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/9.jpg not downloaded yet
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/10.jpg not downloaded yet
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:38 [ayvens.be] INFO: Found listing with ID: 1982339
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982339%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [ayvens.be] INFO: Scrape type for 1982339: 1
2026-03-25 22:46:38 [ayvens.be] INFO: Extracting data for car ID: 1982339
2026-03-25 22:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-25 22:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d96b29-1dca-51e2-a634-54c278f07d69 with scrape type 1
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/1.jpg not downloaded yet
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/2.jpg not downloaded yet
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e0950>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/10.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/3.jpg not downloaded yet
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23611790>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/6.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa37d0>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/3.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236488d0>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/1.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236db550>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/6.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4650>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/9.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/4.jpg not downloaded yet
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/5.jpg not downloaded yet
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7d510>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/4.jpg saved to cache
2026-03-25 22:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b79ed0>
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/5.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/6.jpg not downloaded yet
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/7.jpg not downloaded yet
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/8.jpg not downloaded yet
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/9.jpg not downloaded yet
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/10.jpg not downloaded yet
2026-03-25 22:46:39 [ayvens.be] INFO: Found listing with ID: 1982340
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982340%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [ayvens.be] INFO: Scrape type for 1982340: 1
2026-03-25 22:46:39 [ayvens.be] INFO: Extracting data for car ID: 1982340
2026-03-25 22:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-25 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d8f030-3e13-5662-8c7d-a6278d5b4211 with scrape type 1
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/1.jpg not downloaded yet
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9990>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/9.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/2.jpg not downloaded yet
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825690>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/2.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac0990>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/5.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9ac90>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/10.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7bad0>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/1.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236afa10>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/5.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361d010>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/7.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a50dd0>
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Faf809939461544c78ea55df0a4e28a44%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/8.jpg saved to cache
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf
2026-03-25 22:46:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1e5cde9-97c2-5535-b035-cdb008ccc8cf, skipping ID generation
2026-03-25 22:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf with scrape type 1
2026-03-25 22:46:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1e5cde9-97c2-5535-b035-cdb008ccc8cf sending to next pipeline
2026-03-25 22:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b1e5cde9-97c2-5535-b035-cdb008ccc8cf, identifier: 1982337
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/3.jpg not downloaded yet
2026-03-25 22:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-25 22:46:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337
2026-03-25 22:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b1e5cde9-97c2-5535-b035-cdb008ccc8cf with identifier: 1982337 to the API
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'NOIR OBSIDIENNE METALLISE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b1e5cde9-97c2-5535-b035-cdb008ccc8cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 138110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e5cde9-97c2-5535-b035-cdb008ccc8cf/b1e5cde9-97c2-5535-b035-cdb008ccc8cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/af809939461544c78ea55df0a4e28a44/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 200 D BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 200 D BUS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982337%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [ayvens.be] INFO: Saving data for 1982337: {'created_time': 1774478800.549661, 'last_price_update_time': 1774478800.54967, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982337') HTTP/1.1" 204 0
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/4.jpg not downloaded yet
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/5.jpg not downloaded yet
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/6.jpg not downloaded yet
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/7.jpg not downloaded yet
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/8.jpg not downloaded yet
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/9.jpg not downloaded yet
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/10.jpg not downloaded yet
2026-03-25 22:46:40 [ayvens.be] INFO: Found listing with ID: 1982341
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982341%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [ayvens.be] INFO: Scrape type for 1982341: 1
2026-03-25 22:46:40 [ayvens.be] INFO: Extracting data for car ID: 1982341
2026-03-25 22:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-25 22:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with scrape type 1
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/1.jpg not downloaded yet
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1c050>
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/8.jpg saved to cache
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369f310>
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/7.jpg saved to cache
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/2.jpg not downloaded yet
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23674150>
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/6.jpg saved to cache
2026-03-25 22:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23642410>
2026-03-25 22:46:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/9.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fb090>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/2.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362cb90>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/3.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1410>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/3.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a9190>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/4.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/3.jpg not downloaded yet
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/4.jpg not downloaded yet
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/5.jpg not downloaded yet
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/6.jpg not downloaded yet
2026-03-25 22:46:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/7.jpg not downloaded yet
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/8.jpg not downloaded yet
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/9.jpg not downloaded yet
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e6010>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/6.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/10.jpg not downloaded yet
2026-03-25 22:46:41 [ayvens.be] INFO: Found listing with ID: 1982342
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982342%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [ayvens.be] INFO: Scrape type for 1982342: 1
2026-03-25 22:46:41 [ayvens.be] INFO: Extracting data for car ID: 1982342
2026-03-25 22:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-25 22:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73498a3-7301-5ec3-a68d-6842f08000dd with scrape type 1
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/1.jpg not downloaded yet
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/2.jpg not downloaded yet
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac7f50>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/5.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28808e10>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/10.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879a490>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/7.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c1690>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/1.jpg saved to cache
2026-03-25 22:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799510>
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/1.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879ad90>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/2.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28833cd0>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/4.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/3.jpg not downloaded yet
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/4.jpg not downloaded yet
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/5.jpg not downloaded yet
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/6.jpg not downloaded yet
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/7.jpg not downloaded yet
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/8.jpg not downloaded yet
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28764290>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/5.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/9.jpg not downloaded yet
2026-03-25 22:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/10.jpg not downloaded yet
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603810>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/3.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fbb10>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/9.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fef90>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/1.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881f710>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/4.jpg saved to cache
2026-03-25 22:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883ff50>
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/10.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eca10>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/2.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f9210>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/10.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:43 [ayvens.be] INFO: Found listing with ID: 1982343
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982343%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [ayvens.be] INFO: Scrape type for 1982343: 1
2026-03-25 22:46:43 [ayvens.be] INFO: Extracting data for car ID: 1982343
2026-03-25 22:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-25 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefe2540-1ee0-52bc-9a99-baead36263f7 with scrape type 1
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/1.jpg not downloaded yet
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/2.jpg not downloaded yet
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288dbb90>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/3.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/3.jpg not downloaded yet
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/4.jpg not downloaded yet
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/5.jpg not downloaded yet
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ffb10>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/8.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bab2d0>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/9.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/6.jpg not downloaded yet
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/7.jpg not downloaded yet
2026-03-25 22:46:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d7a50>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/7.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28916890>
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F1424fcf169d443609af4b52cdb3f32b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/6.jpg saved to cache
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50d8f030-3e13-5662-8c7d-a6278d5b4211
2026-03-25 22:46:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50d8f030-3e13-5662-8c7d-a6278d5b4211, skipping ID generation
2026-03-25 22:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d8f030-3e13-5662-8c7d-a6278d5b4211 with scrape type 1
2026-03-25 22:46:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50d8f030-3e13-5662-8c7d-a6278d5b4211 sending to next pipeline
2026-03-25 22:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 50d8f030-3e13-5662-8c7d-a6278d5b4211, identifier: 1982340
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ba8390>
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/5.jpg saved to cache
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccd50>
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/4.jpg saved to cache
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368f710>
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/6.jpg saved to cache
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/8.jpg not downloaded yet
2026-03-25 22:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-25 22:46:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340
2026-03-25 22:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 50d8f030-3e13-5662-8c7d-a6278d5b4211 with identifier: 1982340 to the API
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'CRYSTAL WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '50d8f030-3e13-5662-8c7d-a6278d5b4211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 134118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d8f030-3e13-5662-8c7d-a6278d5b4211/50d8f030-3e13-5662-8c7d-a6278d5b4211_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/1424fcf169d443609af4b52cdb3f32b4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC R-DESIGN TRANSFO VAN',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC R-DESIGN TRANSFO VAN',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982340%27 HTTP/1.1" 200 None
2026-03-25 22:46:44 [ayvens.be] INFO: Saving data for 1982340: {'created_time': 1774478804.888618, 'last_price_update_time': 1774478804.88863, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982340') HTTP/1.1" 204 0
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/9.jpg not downloaded yet
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/10.jpg not downloaded yet
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ea010>
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/2.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [ayvens.be] INFO: Found listing with ID: 1982344
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982344%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [ayvens.be] INFO: Scrape type for 1982344: 1
2026-03-25 22:46:45 [ayvens.be] INFO: Extracting data for car ID: 1982344
2026-03-25 22:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-25 22:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0bf027-1869-5cba-9be5-bc6c487317b9 with scrape type 1
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/1.jpg not downloaded yet
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/2.jpg not downloaded yet
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/3.jpg not downloaded yet
2026-03-25 22:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/4.jpg not downloaded yet
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288d8550>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/1.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0c10>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/3.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/5.jpg not downloaded yet
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/6.jpg not downloaded yet
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/7.jpg not downloaded yet
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff55d0>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/4.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28af8d90>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/9.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876fa50>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/10.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7f690>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/8.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c11b50>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/7.jpg saved to cache
2026-03-25 22:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff4650>
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/10.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/8.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/9.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/10.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [ayvens.be] INFO: Found listing with ID: 1982345
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982345%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [ayvens.be] INFO: Scrape type for 1982345: 1
2026-03-25 22:46:46 [ayvens.be] INFO: Extracting data for car ID: 1982345
2026-03-25 22:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-25 22:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with scrape type 1
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/1.jpg not downloaded yet
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/2.jpg not downloaded yet
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7650>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/1.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2b90>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/3.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790610>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/2.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236afe50>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/4.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/3.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/4.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/5.jpg not downloaded yet
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bd590>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/6.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f0190>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/6.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ce3d0>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/9.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a53210>
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/8.jpg saved to cache
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/6.jpg not downloaded yet
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/7.jpg not downloaded yet
2026-03-25 22:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28914fd0>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/5.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6c990>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/3.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874ae90>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/9.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e9a50>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/8.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28916e90>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/4.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ba590>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/2.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/8.jpg not downloaded yet
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/9.jpg not downloaded yet
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151bf90>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/10.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f1ad0>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/7.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28935b10>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/6.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/10.jpg not downloaded yet
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [ayvens.be] INFO: Found listing with ID: 1982346
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982346%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [ayvens.be] INFO: Scrape type for 1982346: 1
2026-03-25 22:46:47 [ayvens.be] INFO: Extracting data for car ID: 1982346
2026-03-25 22:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-25 22:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6169cd80-e650-504d-b377-0bb023cf43c7 with scrape type 1
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/1.jpg not downloaded yet
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af610>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/7.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/2.jpg not downloaded yet
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/3.jpg not downloaded yet
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/4.jpg not downloaded yet
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21512790>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/1.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150ab90>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/9.jpg saved to cache
2026-03-25 22:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21510f10>
2026-03-25 22:46:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/8.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/5.jpg not downloaded yet
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/6.jpg not downloaded yet
2026-03-25 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839ff50>
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fbeb177f2e0e54d54b4921a573dc47b5e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/5.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fefe2540-1ee0-52bc-9a99-baead36263f7
2026-03-25 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fefe2540-1ee0-52bc-9a99-baead36263f7, skipping ID generation
2026-03-25 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefe2540-1ee0-52bc-9a99-baead36263f7 with scrape type 1
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fefe2540-1ee0-52bc-9a99-baead36263f7 sending to next pipeline
2026-03-25 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fefe2540-1ee0-52bc-9a99-baead36263f7, identifier: 1982343
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f8750>
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252Fa391cbbbccaf4edcaafe38da6be85334%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/5.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c73498a3-7301-5ec3-a68d-6842f08000dd
2026-03-25 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c73498a3-7301-5ec3-a68d-6842f08000dd, skipping ID generation
2026-03-25 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c73498a3-7301-5ec3-a68d-6842f08000dd with scrape type 1
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c73498a3-7301-5ec3-a68d-6842f08000dd sending to next pipeline
2026-03-25 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c73498a3-7301-5ec3-a68d-6842f08000dd, identifier: 1982342
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7e790>
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fe0c5e544300b4389bb82ed66b88d7c4f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/7.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a
2026-03-25 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a, skipping ID generation
2026-03-25 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with scrape type 1
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 913f2d2d-b7d2-5f52-9d16-ac234d31b81a sending to next pipeline
2026-03-25 22:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a, identifier: 1982341
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7ed10>
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/3.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809590>
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fadf8b64f3d2749c9b134a1e474aff534%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/10.jpg saved to cache
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b0bf027-1869-5cba-9be5-bc6c487317b9
2026-03-25 22:46:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b0bf027-1869-5cba-9be5-bc6c487317b9, skipping ID generation
2026-03-25 22:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0bf027-1869-5cba-9be5-bc6c487317b9 with scrape type 1
2026-03-25 22:46:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b0bf027-1869-5cba-9be5-bc6c487317b9 sending to next pipeline
2026-03-25 22:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b0bf027-1869-5cba-9be5-bc6c487317b9, identifier: 1982344
2026-03-25 22:46:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/7.jpg not downloaded yet
2026-03-25 22:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-25 22:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343
2026-03-25 22:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fefe2540-1ee0-52bc-9a99-baead36263f7 with identifier: 1982343 to the API
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fefe2540-1ee0-52bc-9a99-baead36263f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING DIESEL - 2019',
 'odometer': 155118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fefe2540-1ee0-52bc-9a99-baead36263f7/fefe2540-1ee0-52bc-9a99-baead36263f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/beb177f2e0e54d54b4921a573dc47b5e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING DIESEL - 2019 320 dXA MHD AdBlue',
 'transmission': 'automatic',
 'trim': '320 dXA MHD AdBlue',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982343%27 HTTP/1.1" 200 None
2026-03-25 22:46:49 [ayvens.be] INFO: Saving data for 1982343: {'created_time': 1774478809.390058, 'last_price_update_time': 1774478809.39007, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982343') HTTP/1.1" 204 0
2026-03-25 22:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-25 22:46:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342
2026-03-25 22:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c73498a3-7301-5ec3-a68d-6842f08000dd with identifier: 1982342 to the API
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c73498a3-7301-5ec3-a68d-6842f08000dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 140551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c73498a3-7301-5ec3-a68d-6842f08000dd/c73498a3-7301-5ec3-a68d-6842f08000dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/a391cbbbccaf4edcaafe38da6be85334/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D3 Inscription AdBlue',
 'transmission': 'manual',
 'trim': '2.0 D3 Inscription AdBlue',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982342%27 HTTP/1.1" 200 None
2026-03-25 22:46:49 [ayvens.be] INFO: Saving data for 1982342: {'created_time': 1774478809.778097, 'last_price_update_time': 1774478809.778107, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982342') HTTP/1.1" 204 0
2026-03-25 22:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-25 22:46:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341
2026-03-25 22:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 913f2d2d-b7d2-5f52-9d16-ac234d31b81a with identifier: 1982341 to the API
2026-03-25 22:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'CANDY WHITE',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '913f2d2d-b7d2-5f52-9d16-ac234d31b81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI DIESEL - 2015',
 'odometer': 152698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f2d2d-b7d2-5f52-9d16-ac234d31b81a/913f2d2d-b7d2-5f52-9d16-ac234d31b81a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/e0c5e544300b4389bb82ed66b88d7c4f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI DIESEL - 2015 2.0 TDi SCR Conceptline (EU6.2) '
          'Transfo Van',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Conceptline (EU6.2) Transfo Van',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982341%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [ayvens.be] INFO: Saving data for 1982341: {'created_time': 1774478810.138818, 'last_price_update_time': 1774478810.13883, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982341') HTTP/1.1" 204 0
2026-03-25 22:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-25 22:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344
2026-03-25 22:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b0bf027-1869-5cba-9be5-bc6c487317b9 with identifier: 1982344 to the API
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3b0bf027-1869-5cba-9be5-bc6c487317b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 142790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b0bf027-1869-5cba-9be5-bc6c487317b9/3b0bf027-1869-5cba-9be5-bc6c487317b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/adf8b64f3d2749c9b134a1e474aff534/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN 2.0 TDI 110KW HIGHLINE DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW HIGHLINE DSG',
 'vin': None,
 'year': 2021}
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982344%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [ayvens.be] INFO: Saving data for 1982344: {'created_time': 1774478810.497817, 'last_price_update_time': 1774478810.497827, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982344') HTTP/1.1" 204 0
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/8.jpg not downloaded yet
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/9.jpg not downloaded yet
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ea750>
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/2.jpg saved to cache
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c1b50>
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/4.jpg saved to cache
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c2a50>
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/1.jpg saved to cache
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/10.jpg not downloaded yet
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [ayvens.be] INFO: Found listing with ID: 1982347
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982347%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [ayvens.be] INFO: Scrape type for 1982347: 1
2026-03-25 22:46:50 [ayvens.be] INFO: Extracting data for car ID: 1982347
2026-03-25 22:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-25 22:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64300d52-37b6-58ad-926a-f5f378e1bb2b with scrape type 1
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/1.jpg not downloaded yet
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21508190>
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/5.jpg saved to cache
2026-03-25 22:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/2.jpg not downloaded yet
2026-03-25 22:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362e4d0>
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yc%252F51defefd08674f649ce83c02457f938c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/2.jpg saved to cache
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c17b7144-1840-536d-9e87-64ba56072f21
2026-03-25 22:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c17b7144-1840-536d-9e87-64ba56072f21, skipping ID generation
2026-03-25 22:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17b7144-1840-536d-9e87-64ba56072f21 with scrape type 1
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c17b7144-1840-536d-9e87-64ba56072f21 sending to next pipeline
2026-03-25 22:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c17b7144-1840-536d-9e87-64ba56072f21, identifier: 1982338
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21529090>
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F8cf7050be4e54c54b658e34eac2368c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/8.jpg saved to cache
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03d96b29-1dca-51e2-a634-54c278f07d69
2026-03-25 22:46:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03d96b29-1dca-51e2-a634-54c278f07d69, skipping ID generation
2026-03-25 22:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d96b29-1dca-51e2-a634-54c278f07d69 with scrape type 1
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03d96b29-1dca-51e2-a634-54c278f07d69 sending to next pipeline
2026-03-25 22:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 03d96b29-1dca-51e2-a634-54c278f07d69, identifier: 1982339
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/3.jpg not downloaded yet
2026-03-25 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-25 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338
2026-03-25 22:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c17b7144-1840-536d-9e87-64ba56072f21 with identifier: 1982338 to the API
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'NACRE WIT PARELKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c17b7144-1840-536d-9e87-64ba56072f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 134405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17b7144-1840-536d-9e87-64ba56072f21/c17b7144-1840-536d-9e87-64ba56072f21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yc/51defefd08674f649ce83c02457f938c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO CROSSWAY',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO CROSSWAY',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982338%27 HTTP/1.1" 200 None
2026-03-25 22:46:51 [ayvens.be] INFO: Saving data for 1982338: {'created_time': 1774478811.68787, 'last_price_update_time': 1774478811.68788, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982338') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-25 22:46:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339
2026-03-25 22:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 03d96b29-1dca-51e2-a634-54c278f07d69 with identifier: 1982339 to the API
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'MAGNETIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '03d96b29-1dca-51e2-a634-54c278f07d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER DIESEL - 2018',
 'odometer': 147787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03d96b29-1dca-51e2-a634-54c278f07d69/03d96b29-1dca-51e2-a634-54c278f07d69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/8cf7050be4e54c54b658e34eac2368c5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER DIESEL - 2018 1.5 EcoBlue Trend Edition Bus. '
          '(EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue Trend Edition Bus. (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982339%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [ayvens.be] INFO: Saving data for 1982339: {'created_time': 1774478812.065567, 'last_price_update_time': 1774478812.065577, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982339') HTTP/1.1" 204 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/4.jpg not downloaded yet
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff5350>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/6.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516850>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/8.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28792e50>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/7.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515f10>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/9.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/5.jpg not downloaded yet
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/6.jpg not downloaded yet
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/7.jpg not downloaded yet
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/8.jpg not downloaded yet
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/9.jpg not downloaded yet
2026-03-25 22:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/10.jpg not downloaded yet
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236da5d0>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/4.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:52 [ayvens.be] INFO: Found listing with ID: 1982348
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982348%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [ayvens.be] INFO: Scrape type for 1982348: 1
2026-03-25 22:46:52 [ayvens.be] INFO: Extracting data for car ID: 1982348
2026-03-25 22:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-25 22:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc18215-eeba-51d7-9900-4cec45a42db8 with scrape type 1
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/1.jpg not downloaded yet
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/2.jpg not downloaded yet
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/3.jpg not downloaded yet
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e40350>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vt%252F5b445a718d9741d68c075e61656d0f6d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/10.jpg saved to cache
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f
2026-03-25 22:46:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f, skipping ID generation
2026-03-25 22:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with scrape type 1
2026-03-25 22:46:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6acaa694-d3c3-5f58-b05a-1ff123a94e0f sending to next pipeline
2026-03-25 22:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f, identifier: 1982345
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a53b610>
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/2.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287905d0>
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F0b6afb125b36416fb187f0133bbec303%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/3.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69
2026-03-25 22:46:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff12b6a1-744a-5afb-8455-8dbc4dd88f69, skipping ID generation
2026-03-25 22:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with scrape type 1
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff12b6a1-744a-5afb-8455-8dbc4dd88f69 sending to next pipeline
2026-03-25 22:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff12b6a1-744a-5afb-8455-8dbc4dd88f69, identifier: 1982336
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5cf10>
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/1.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515250>
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/3.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee210>
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/5.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc52d0>
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/4.jpg saved to cache
2026-03-25 22:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-25 22:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345
2026-03-25 22:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6acaa694-d3c3-5f58-b05a-1ff123a94e0f with identifier: 1982345 to the API
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6acaa694-d3c3-5f58-b05a-1ff123a94e0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 199961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6acaa694-d3c3-5f58-b05a-1ff123a94e0f/6acaa694-d3c3-5f58-b05a-1ff123a94e0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vt/5b445a718d9741d68c075e61656d0f6d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI ACT Ambition (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982345%27 HTTP/1.1" 200 None
2026-03-25 22:46:53 [ayvens.be] INFO: Saving data for 1982345: {'created_time': 1774478813.913185, 'last_price_update_time': 1774478813.913195, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982345') HTTP/1.1" 204 0
2026-03-25 22:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-25 22:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336
2026-03-25 22:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff12b6a1-744a-5afb-8455-8dbc4dd88f69 with identifier: 1982336 to the API
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ff12b6a1-744a-5afb-8455-8dbc4dd88f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 218065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff12b6a1-744a-5afb-8455-8dbc4dd88f69/ff12b6a1-744a-5afb-8455-8dbc4dd88f69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/0b6afb125b36416fb187f0133bbec303/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S&S ALLURE',
 'vin': None,
 'year': 2022}
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982336%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [ayvens.be] INFO: Saving data for 1982336: {'created_time': 1774478814.266784, 'last_price_update_time': 1774478814.266793, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982336') HTTP/1.1" 204 0
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/4.jpg not downloaded yet
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/5.jpg not downloaded yet
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/6.jpg not downloaded yet
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/7.jpg not downloaded yet
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/8.jpg not downloaded yet
2026-03-25 22:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/9.jpg not downloaded yet
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/10.jpg not downloaded yet
2026-03-25 22:46:54 [ayvens.be] INFO: Found listing with ID: 1982349
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982349%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [ayvens.be] INFO: Scrape type for 1982349: 1
2026-03-25 22:46:54 [ayvens.be] INFO: Extracting data for car ID: 1982349
2026-03-25 22:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-25 22:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with scrape type 1
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/1.jpg not downloaded yet
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28849090>
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/8.jpg saved to cache
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f8990>
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vu%252F1d775a59c08a4483a630eea6d9591e2d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/5.jpg saved to cache
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e44bb305-671e-5a96-aed0-8f3645b2ee04
2026-03-25 22:46:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e44bb305-671e-5a96-aed0-8f3645b2ee04, skipping ID generation
2026-03-25 22:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44bb305-671e-5a96-aed0-8f3645b2ee04 with scrape type 1
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e44bb305-671e-5a96-aed0-8f3645b2ee04 sending to next pipeline
2026-03-25 22:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e44bb305-671e-5a96-aed0-8f3645b2ee04, identifier: 1982334
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/2.jpg not downloaded yet
2026-03-25 22:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-25 22:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334
2026-03-25 22:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e44bb305-671e-5a96-aed0-8f3645b2ee04 with identifier: 1982334 to the API
2026-03-25 22:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e44bb305-671e-5a96-aed0-8f3645b2ee04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 DIESEL - 2019',
 'odometer': 173396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44bb305-671e-5a96-aed0-8f3645b2ee04/e44bb305-671e-5a96-aed0-8f3645b2ee04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vu/1d775a59c08a4483a630eea6d9591e2d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 DIESEL - 2019 35 TDi (EU6d-TEMP) STOCK',
 'transmission': 'manual',
 'trim': '35 TDi (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982334%27 HTTP/1.1" 200 None
2026-03-25 22:46:55 [ayvens.be] INFO: Saving data for 1982334: {'created_time': 1774478815.97775, 'last_price_update_time': 1774478815.97776, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982334') HTTP/1.1" 204 0
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b48f50>
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/7.jpg saved to cache
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28934d50>
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/6.jpg saved to cache
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a849b90>
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1tq%252F451f10601f154520a4367a529259bfd8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/6.jpg saved to cache
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f27e9242-9738-549f-a594-37d64626cefe
2026-03-25 22:46:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f27e9242-9738-549f-a594-37d64626cefe, skipping ID generation
2026-03-25 22:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f27e9242-9738-549f-a594-37d64626cefe with scrape type 1
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f27e9242-9738-549f-a594-37d64626cefe sending to next pipeline
2026-03-25 22:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f27e9242-9738-549f-a594-37d64626cefe, identifier: 1982333
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/3.jpg not downloaded yet
2026-03-25 22:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-25 22:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333
2026-03-25 22:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f27e9242-9738-549f-a594-37d64626cefe with identifier: 1982333 to the API
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f27e9242-9738-549f-a594-37d64626cefe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 175816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 915997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f27e9242-9738-549f-a594-37d64626cefe/f27e9242-9738-549f-a594-37d64626cefe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1tq/451f10601f154520a4367a529259bfd8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 1.6 BlueHDi L2 Standard '
          'Premium STOCK',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi L2 Standard Premium STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982333%27 HTTP/1.1" 200 None
2026-03-25 22:46:56 [ayvens.be] INFO: Saving data for 1982333: {'created_time': 1774478816.927094, 'last_price_update_time': 1774478816.927106, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982333') HTTP/1.1" 204 0
2026-03-25 22:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/4.jpg not downloaded yet
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28935610>
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/9.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c1750>
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F2a0eff04443347d5ae7b8195b3658931%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/10.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6169cd80-e650-504d-b377-0bb023cf43c7
2026-03-25 22:46:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6169cd80-e650-504d-b377-0bb023cf43c7, skipping ID generation
2026-03-25 22:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6169cd80-e650-504d-b377-0bb023cf43c7 with scrape type 1
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6169cd80-e650-504d-b377-0bb023cf43c7 sending to next pipeline
2026-03-25 22:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6169cd80-e650-504d-b377-0bb023cf43c7, identifier: 1982346
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a97d0>
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/1.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-25 22:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346
2026-03-25 22:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6169cd80-e650-504d-b377-0bb023cf43c7 with identifier: 1982346 to the API
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6169cd80-e650-504d-b377-0bb023cf43c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 161249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6169cd80-e650-504d-b377-0bb023cf43c7/6169cd80-e650-504d-b377-0bb023cf43c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/2a0eff04443347d5ae7b8195b3658931/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2020}
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982346%27 HTTP/1.1" 200 None
2026-03-25 22:46:57 [ayvens.be] INFO: Saving data for 1982346: {'created_time': 1774478817.638513, 'last_price_update_time': 1774478817.638523, 'auction_closing_time': 1774942200.0}
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982346') HTTP/1.1" 204 0
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/5.jpg not downloaded yet
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/6.jpg not downloaded yet
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e9650>
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/3.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/7.jpg not downloaded yet
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/8.jpg not downloaded yet
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1ca10>
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/4.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289eae90>
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/6.jpg saved to cache
2026-03-25 22:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/9.jpg not downloaded yet
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368f990>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/7.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877d690>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/2.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288272d0>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/1.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236af190>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/5.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/10.jpg not downloaded yet
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [ayvens.be] INFO: Found listing with ID: 1982350
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982350%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [ayvens.be] INFO: Scrape type for 1982350: 1
2026-03-25 22:46:58 [ayvens.be] INFO: Extracting data for car ID: 1982350
2026-03-25 22:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-25 22:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35ee64d-0ec6-584a-a656-f24bce655830 with scrape type 1
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/1.jpg not downloaded yet
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bc510>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/10.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/2.jpg not downloaded yet
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/3.jpg not downloaded yet
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28af8090>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/4.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/4.jpg not downloaded yet
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/5.jpg not downloaded yet
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/6.jpg not downloaded yet
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890e650>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/3.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21522a50>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/5.jpg saved to cache
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/7.jpg not downloaded yet
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8d90>
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/2.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b1d90>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/6.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362e090>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/10.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af890>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/2.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/8.jpg not downloaded yet
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a94a90>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/1.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/9.jpg not downloaded yet
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/10.jpg not downloaded yet
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [ayvens.be] INFO: Found listing with ID: 1982351
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982351%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [ayvens.be] INFO: Scrape type for 1982351: 1
2026-03-25 22:46:59 [ayvens.be] INFO: Extracting data for car ID: 1982351
2026-03-25 22:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-25 22:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with scrape type 1
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/1.jpg not downloaded yet
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b4390>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/3.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/2.jpg not downloaded yet
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23655990>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/4.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/3.jpg not downloaded yet
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fa790>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/5.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eac90>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/9.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/4.jpg not downloaded yet
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/5.jpg not downloaded yet
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884b390>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/10.jpg saved to cache
2026-03-25 22:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367ff90>
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:46:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:46:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/7.jpg saved to cache
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503790>
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fa986a56221664f1d8ab84b90c602a9e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/8.jpg saved to cache
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccc18215-eeba-51d7-9900-4cec45a42db8
2026-03-25 22:47:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccc18215-eeba-51d7-9900-4cec45a42db8, skipping ID generation
2026-03-25 22:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc18215-eeba-51d7-9900-4cec45a42db8 with scrape type 1
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccc18215-eeba-51d7-9900-4cec45a42db8 sending to next pipeline
2026-03-25 22:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ccc18215-eeba-51d7-9900-4cec45a42db8, identifier: 1982348
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-25 22:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348
2026-03-25 22:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ccc18215-eeba-51d7-9900-4cec45a42db8 with identifier: 1982348 to the API
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ccc18215-eeba-51d7-9900-4cec45a42db8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 167539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccc18215-eeba-51d7-9900-4cec45a42db8/ccc18215-eeba-51d7-9900-4cec45a42db8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/a986a56221664f1d8ab84b90c602a9e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 2.0 30 TDI S TRONIC ADVANCED BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC ADVANCED BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982348%27 HTTP/1.1" 200 None
2026-03-25 22:47:00 [ayvens.be] INFO: Saving data for 1982348: {'created_time': 1774478820.748151, 'last_price_update_time': 1774478820.74816, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982348') HTTP/1.1" 204 0
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/6.jpg not downloaded yet
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/7.jpg not downloaded yet
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236405d0>
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/8.jpg saved to cache
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/8.jpg not downloaded yet
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/9.jpg not downloaded yet
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a354d50>
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/1.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817cd0>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/10.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368eb50>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/9.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/10.jpg not downloaded yet
2026-03-25 22:47:01 [ayvens.be] INFO: Found listing with ID: 1982352
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982352%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [ayvens.be] INFO: Scrape type for 1982352: 1
2026-03-25 22:47:01 [ayvens.be] INFO: Extracting data for car ID: 1982352
2026-03-25 22:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-25 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a245134c-4e87-5115-a573-4691a07681a0 with scrape type 1
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/1.jpg not downloaded yet
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a94990>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/9.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99bd0>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/2.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814ad0>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/6.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/2.jpg not downloaded yet
2026-03-25 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/3.jpg not downloaded yet
2026-03-25 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/4.jpg not downloaded yet
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369df50>
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F130b0282416946eda2281e3ef1dac00c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/7.jpg saved to cache
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af
2026-03-25 22:47:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af, skipping ID generation
2026-03-25 22:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with scrape type 1
2026-03-25 22:47:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af sending to next pipeline
2026-03-25 22:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af, identifier: 1982349
2026-03-25 22:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-25 22:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349
2026-03-25 22:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6cb974a7-8bc0-5c94-8ee6-4a477d1d77af with identifier: 1982349 to the API
2026-03-25 22:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '6cb974a7-8bc0-5c94-8ee6-4a477d1d77af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Vivaro',
 'odometer': 167206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cb974a7-8bc0-5c94-8ee6-4a477d1d77af/6cb974a7-8bc0-5c94-8ee6-4a477d1d77af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/130b0282416946eda2281e3ef1dac00c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'OPEL Vivaro 2.0 TURBO 106KW INNOVATION L3H1 AUTO',
 'transmission': 'automatic',
 'trim': '2.0 TURBO 106KW INNOVATION L3H1 AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982349%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [ayvens.be] INFO: Saving data for 1982349: {'created_time': 1774478822.241517, 'last_price_update_time': 1774478822.241527, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982349') HTTP/1.1" 204 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/5.jpg not downloaded yet
2026-03-25 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/6.jpg not downloaded yet
2026-03-25 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2c850>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/7.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a5650>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/5.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af990>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/10.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b350>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/6.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/7.jpg not downloaded yet
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/8.jpg not downloaded yet
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151af90>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/4.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28818d10>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/8.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23656190>
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/9.jpg saved to cache
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/9.jpg not downloaded yet
2026-03-25 22:47:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/10.jpg not downloaded yet
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2ab848d0>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/1.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [ayvens.be] INFO: Found listing with ID: 1982353
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982353%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [ayvens.be] INFO: Scrape type for 1982353: 1
2026-03-25 22:47:03 [ayvens.be] INFO: Extracting data for car ID: 1982353
2026-03-25 22:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-25 22:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9a13e0-8bd8-5101-8235-801ece0e6766 with scrape type 1
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/1.jpg not downloaded yet
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/2.jpg not downloaded yet
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/3.jpg not downloaded yet
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e41190>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/5.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21502ed0>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/6.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/4.jpg not downloaded yet
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/5.jpg not downloaded yet
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627890>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/4.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21512f10>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/3.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b68d0>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/7.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/6.jpg not downloaded yet
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/7.jpg not downloaded yet
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c3350>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/9.jpg saved to cache
2026-03-25 22:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a97590>
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/2.jpg saved to cache
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150cd90>
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/8.jpg saved to cache
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/8.jpg not downloaded yet
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/9.jpg not downloaded yet
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/10.jpg not downloaded yet
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [ayvens.be] INFO: Found listing with ID: 1982354
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982354%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [ayvens.be] INFO: Scrape type for 1982354: 1
2026-03-25 22:47:04 [ayvens.be] INFO: Extracting data for car ID: 1982354
2026-03-25 22:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-25 22:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0314240d-b381-5798-98ae-4d0788a8f32a with scrape type 1
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/1.jpg not downloaded yet
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/2.jpg not downloaded yet
2026-03-25 22:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b1b90>
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/1.jpg saved to cache
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa1590>
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/2.jpg saved to cache
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac7d50>
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/3.jpg saved to cache
2026-03-25 22:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad6d0>
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252Fc75042a479bc4798b0a8481d1bbe71a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/10.jpg saved to cache
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd
2026-03-25 22:47:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd, skipping ID generation
2026-03-25 22:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with scrape type 1
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd sending to next pipeline
2026-03-25 22:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd, identifier: 1982351
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/3.jpg not downloaded yet
2026-03-25 22:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-25 22:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351
2026-03-25 22:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd with identifier: 1982351 to the API
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 183975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd/1a39e4b4-9ce8-5cb4-9929-e88c92c19cfd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/c75042a479bc4798b0a8481d1bbe71a1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982351%27 HTTP/1.1" 200 None
2026-03-25 22:47:05 [ayvens.be] INFO: Saving data for 1982351: {'created_time': 1774478825.69092, 'last_price_update_time': 1774478825.69093, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982351') HTTP/1.1" 204 0
2026-03-25 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/4.jpg not downloaded yet
2026-03-25 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/5.jpg not downloaded yet
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b24d0>
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/5.jpg saved to cache
2026-03-25 22:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825350>
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252Feadf2eddddff49a3a3c5631eca67700e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/3.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e35ee64d-0ec6-584a-a656-f24bce655830
2026-03-25 22:47:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e35ee64d-0ec6-584a-a656-f24bce655830, skipping ID generation
2026-03-25 22:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35ee64d-0ec6-584a-a656-f24bce655830 with scrape type 1
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e35ee64d-0ec6-584a-a656-f24bce655830 sending to next pipeline
2026-03-25 22:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e35ee64d-0ec6-584a-a656-f24bce655830, identifier: 1982350
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99c10>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/4.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f56d0>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/6.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-25 22:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350
2026-03-25 22:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e35ee64d-0ec6-584a-a656-f24bce655830 with identifier: 1982350 to the API
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e35ee64d-0ec6-584a-a656-f24bce655830',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 197795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35ee64d-0ec6-584a-a656-f24bce655830/e35ee64d-0ec6-584a-a656-f24bce655830_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/eadf2eddddff49a3a3c5631eca67700e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 CRTDI 85KW DSG7 CLEVER+',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER+',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982350%27 HTTP/1.1" 200 None
2026-03-25 22:47:06 [ayvens.be] INFO: Saving data for 1982350: {'created_time': 1774478826.626647, 'last_price_update_time': 1774478826.626658, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982350') HTTP/1.1" 204 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/6.jpg not downloaded yet
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/7.jpg not downloaded yet
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 2 pages/min), scraped 34 items (at 27 items/min)
2026-03-25 22:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a61ed0>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/3.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23624710>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/1.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a7110>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/2.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28765390>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/4.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/8.jpg not downloaded yet
2026-03-25 22:47:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/9.jpg not downloaded yet
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23625450>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/8.jpg saved to cache
2026-03-25 22:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f12d0>
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/9.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a97290>
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/10.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23625450>
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/7.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/10.jpg not downloaded yet
2026-03-25 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:07 [ayvens.be] INFO: Found listing with ID: 1982355
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982355%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [ayvens.be] INFO: Scrape type for 1982355: 1
2026-03-25 22:47:07 [ayvens.be] INFO: Extracting data for car ID: 1982355
2026-03-25 22:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-25 22:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ad896d-e91c-5202-9835-1dfea3e44517 with scrape type 1
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/1.jpg not downloaded yet
2026-03-25 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a361d10>
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F4f7b29b2bdba40418813e914149c802a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/7.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a245134c-4e87-5115-a573-4691a07681a0
2026-03-25 22:47:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a245134c-4e87-5115-a573-4691a07681a0, skipping ID generation
2026-03-25 22:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a245134c-4e87-5115-a573-4691a07681a0 with scrape type 1
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a245134c-4e87-5115-a573-4691a07681a0 sending to next pipeline
2026-03-25 22:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a245134c-4e87-5115-a573-4691a07681a0, identifier: 1982352
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac63d0>
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/5.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215096d0>
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/6.jpg saved to cache
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/2.jpg not downloaded yet
2026-03-25 22:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-25 22:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352
2026-03-25 22:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a245134c-4e87-5115-a573-4691a07681a0 with identifier: 1982352 to the API
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a245134c-4e87-5115-a573-4691a07681a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 204053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a245134c-4e87-5115-a573-4691a07681a0/a245134c-4e87-5115-a573-4691a07681a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/4f7b29b2bdba40418813e914149c802a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982352%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [ayvens.be] INFO: Saving data for 1982352: {'created_time': 1774478827.960688, 'last_price_update_time': 1774478827.960698, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982352') HTTP/1.1" 204 0
2026-03-25 22:47:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/3.jpg not downloaded yet
2026-03-25 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/4.jpg not downloaded yet
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368fa50>
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/8.jpg saved to cache
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901e210>
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/9.jpg saved to cache
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff49d0>
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F42b42c4df0254350ad76ea49c023ab72%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/10.jpg saved to cache
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da9a13e0-8bd8-5101-8235-801ece0e6766
2026-03-25 22:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da9a13e0-8bd8-5101-8235-801ece0e6766, skipping ID generation
2026-03-25 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9a13e0-8bd8-5101-8235-801ece0e6766 with scrape type 1
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da9a13e0-8bd8-5101-8235-801ece0e6766 sending to next pipeline
2026-03-25 22:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: da9a13e0-8bd8-5101-8235-801ece0e6766, identifier: 1982353
2026-03-25 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-25 22:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353
2026-03-25 22:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: da9a13e0-8bd8-5101-8235-801ece0e6766 with identifier: 1982353 to the API
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'da9a13e0-8bd8-5101-8235-801ece0e6766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da9a13e0-8bd8-5101-8235-801ece0e6766/da9a13e0-8bd8-5101-8235-801ece0e6766_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/42b42c4df0254350ad76ea49c023ab72/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18IA (100KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982353%27 HTTP/1.1" 200 None
2026-03-25 22:47:08 [ayvens.be] INFO: Saving data for 1982353: {'created_time': 1774478828.685969, 'last_price_update_time': 1774478828.685979, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982353') HTTP/1.1" 204 0
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/5.jpg not downloaded yet
2026-03-25 22:47:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/6.jpg not downloaded yet
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28927750>
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0066b880ce6446f5b5d66987d467735a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/8.jpg saved to cache
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64300d52-37b6-58ad-926a-f5f378e1bb2b
2026-03-25 22:47:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64300d52-37b6-58ad-926a-f5f378e1bb2b, skipping ID generation
2026-03-25 22:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64300d52-37b6-58ad-926a-f5f378e1bb2b with scrape type 1
2026-03-25 22:47:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64300d52-37b6-58ad-926a-f5f378e1bb2b sending to next pipeline
2026-03-25 22:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 64300d52-37b6-58ad-926a-f5f378e1bb2b, identifier: 1982347
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad910>
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/3.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8350>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/4.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361e850>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/2.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/7.jpg not downloaded yet
2026-03-25 22:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-25 22:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347
2026-03-25 22:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 64300d52-37b6-58ad-926a-f5f378e1bb2b with identifier: 1982347 to the API
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '64300d52-37b6-58ad-926a-f5f378e1bb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLA DIESEL (H247)',
 'odometer': 207172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64300d52-37b6-58ad-926a-f5f378e1bb2b/64300d52-37b6-58ad-926a-f5f378e1bb2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0066b880ce6446f5b5d66987d467735a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLA DIESEL (H247) GLA 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLA 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982347%27 HTTP/1.1" 200 None
2026-03-25 22:47:09 [ayvens.be] INFO: Saving data for 1982347: {'created_time': 1774478829.577431, 'last_price_update_time': 1774478829.577441, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982347') HTTP/1.1" 204 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/8.jpg not downloaded yet
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892eed0>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/5.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/9.jpg not downloaded yet
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c8a50>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/1.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/10.jpg not downloaded yet
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c105d0>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/9.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ad34d0>
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F62db8fc65ef941e3be95eebb4f35e137%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/8.jpg saved to cache
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72
2026-03-25 22:47:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72, skipping ID generation
2026-03-25 22:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with scrape type 1
2026-03-25 22:47:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 sending to next pipeline
2026-03-25 22:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72, identifier: 1982207
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368f350>
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/6.jpg saved to cache
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:10 [ayvens.be] INFO: Found listing with ID: 1982356
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982356%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [ayvens.be] INFO: Scrape type for 1982356: 1
2026-03-25 22:47:10 [ayvens.be] INFO: Extracting data for car ID: 1982356
2026-03-25 22:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-25 22:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6743647-357c-5f2f-89ac-6b555c76e721 with scrape type 1
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/1.jpg not downloaded yet
2026-03-25 22:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with identifier: 1982207
2026-03-25 22:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with identifier: 1982207
2026-03-25 22:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72 with identifier: 1982207 to the API
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 28922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72/3ef28fd4-fa38-52f7-b04e-3a91ed4e3a72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/62db8fc65ef941e3be95eebb4f35e137/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982207%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [ayvens.be] INFO: Saving data for 1982207: {'created_time': 1774478830.495281, 'last_price_update_time': 1774478830.495295, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982207') HTTP/1.1" 204 0
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/2.jpg not downloaded yet
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/3.jpg not downloaded yet
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/4.jpg not downloaded yet
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/5.jpg not downloaded yet
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/6.jpg not downloaded yet
2026-03-25 22:47:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/7.jpg not downloaded yet
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2f50>
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/9.jpg saved to cache
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ff90>
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/7.jpg saved to cache
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/8.jpg not downloaded yet
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/9.jpg not downloaded yet
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a355b50>
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/8.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6ffd0>
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/9.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901fe90>
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb0ce94b72ab34d7a9e881490088559a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/8.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82a7832d-e38a-5e79-a590-d21086305cb7
2026-03-25 22:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82a7832d-e38a-5e79-a590-d21086305cb7, skipping ID generation
2026-03-25 22:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a7832d-e38a-5e79-a590-d21086305cb7 with scrape type 1
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82a7832d-e38a-5e79-a590-d21086305cb7 sending to next pipeline
2026-03-25 22:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82a7832d-e38a-5e79-a590-d21086305cb7, identifier: 1982206
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926690>
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/1.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ce90>
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F9e6e7ace89e9478f8ba6f35d2695b4e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/10.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0314240d-b381-5798-98ae-4d0788a8f32a
2026-03-25 22:47:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0314240d-b381-5798-98ae-4d0788a8f32a, skipping ID generation
2026-03-25 22:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0314240d-b381-5798-98ae-4d0788a8f32a with scrape type 1
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0314240d-b381-5798-98ae-4d0788a8f32a sending to next pipeline
2026-03-25 22:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0314240d-b381-5798-98ae-4d0788a8f32a, identifier: 1982354
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fcf10>
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/10.jpg saved to cache
2026-03-25 22:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82a7832d-e38a-5e79-a590-d21086305cb7 with identifier: 1982206
2026-03-25 22:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82a7832d-e38a-5e79-a590-d21086305cb7 with identifier: 1982206
2026-03-25 22:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82a7832d-e38a-5e79-a590-d21086305cb7 with identifier: 1982206 to the API
2026-03-25 22:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '82a7832d-e38a-5e79-a590-d21086305cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 42984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 942401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a7832d-e38a-5e79-a590-d21086305cb7/82a7832d-e38a-5e79-a590-d21086305cb7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b0ce94b72ab34d7a9e881490088559a0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982206%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [ayvens.be] INFO: Saving data for 1982206: {'created_time': 1774478832.214629, 'last_price_update_time': 1774478832.214639, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982206') HTTP/1.1" 204 0
2026-03-25 22:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-25 22:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354
2026-03-25 22:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0314240d-b381-5798-98ae-4d0788a8f32a with identifier: 1982354 to the API
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0314240d-b381-5798-98ae-4d0788a8f32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 55941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0314240d-b381-5798-98ae-4d0788a8f32a/0314240d-b381-5798-98ae-4d0788a8f32a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/9e6e7ace89e9478f8ba6f35d2695b4e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2023}
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982354%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [ayvens.be] INFO: Saving data for 1982354: {'created_time': 1774478832.573938, 'last_price_update_time': 1774478832.573947, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982354') HTTP/1.1" 204 0
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/10.jpg not downloaded yet
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [ayvens.be] INFO: Found listing with ID: 1982357
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982357%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [ayvens.be] INFO: Scrape type for 1982357: 1
2026-03-25 22:47:12 [ayvens.be] INFO: Extracting data for car ID: 1982357
2026-03-25 22:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-25 22:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b6005f-c543-5e51-80c8-6fa0585684e9 with scrape type 1
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/1.jpg not downloaded yet
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/2.jpg not downloaded yet
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/3.jpg not downloaded yet
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/4.jpg not downloaded yet
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/5.jpg not downloaded yet
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/6.jpg not downloaded yet
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150ff50>
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/5.jpg saved to cache
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/7.jpg not downloaded yet
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/8.jpg not downloaded yet
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ea7d0>
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/2.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e66d0>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/4.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516690>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/6.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a06290>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/3.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6df10>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/8.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c1310>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/7.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a06ed0>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/9.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/9.jpg not downloaded yet
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/10.jpg not downloaded yet
2026-03-25 22:47:13 [ayvens.be] INFO: Found listing with ID: 1982358
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982358%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [ayvens.be] INFO: Scrape type for 1982358: 1
2026-03-25 22:47:13 [ayvens.be] INFO: Extracting data for car ID: 1982358
2026-03-25 22:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-25 22:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e with scrape type 1
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/1.jpg not downloaded yet
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/2.jpg not downloaded yet
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/3.jpg not downloaded yet
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/4.jpg not downloaded yet
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/5.jpg not downloaded yet
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/6.jpg not downloaded yet
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/7.jpg not downloaded yet
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ffed0>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/2.jpg saved to cache
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/8.jpg not downloaded yet
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f93d0>
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/4.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df98d0>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/1.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aec7d0>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/3.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/9.jpg not downloaded yet
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/10.jpg not downloaded yet
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150f510>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F3d4a3467542c4a8f85f5b960f7b741ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/8.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2a659f7-eb95-5bd0-8750-c7463129a097
2026-03-25 22:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a659f7-eb95-5bd0-8750-c7463129a097, skipping ID generation
2026-03-25 22:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a659f7-eb95-5bd0-8750-c7463129a097 with scrape type 1
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a659f7-eb95-5bd0-8750-c7463129a097 sending to next pipeline
2026-03-25 22:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2a659f7-eb95-5bd0-8750-c7463129a097, identifier: 1982205
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b710>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/9.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a6b250>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dk%252Fd5bf98d50168480b933868edb6533e17%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/10.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62ad896d-e91c-5202-9835-1dfea3e44517
2026-03-25 22:47:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ad896d-e91c-5202-9835-1dfea3e44517, skipping ID generation
2026-03-25 22:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ad896d-e91c-5202-9835-1dfea3e44517 with scrape type 1
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ad896d-e91c-5202-9835-1dfea3e44517 sending to next pipeline
2026-03-25 22:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62ad896d-e91c-5202-9835-1dfea3e44517, identifier: 1982355
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a96790>
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/8.jpg saved to cache
2026-03-25 22:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2a659f7-eb95-5bd0-8750-c7463129a097 with identifier: 1982205
2026-03-25 22:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2a659f7-eb95-5bd0-8750-c7463129a097 with identifier: 1982205
2026-03-25 22:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2a659f7-eb95-5bd0-8750-c7463129a097 with identifier: 1982205 to the API
2026-03-25 22:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd2a659f7-eb95-5bd0-8750-c7463129a097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 34015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a659f7-eb95-5bd0-8750-c7463129a097/d2a659f7-eb95-5bd0-8750-c7463129a097_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 762888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/3d4a3467542c4a8f85f5b960f7b741ca/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982205%27 HTTP/1.1" 200 None
2026-03-25 22:47:15 [ayvens.be] INFO: Saving data for 1982205: {'created_time': 1774478835.189299, 'last_price_update_time': 1774478835.189308, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982205') HTTP/1.1" 204 0
2026-03-25 22:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-25 22:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355
2026-03-25 22:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62ad896d-e91c-5202-9835-1dfea3e44517 with identifier: 1982355 to the API
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '62ad896d-e91c-5202-9835-1dfea3e44517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 X',
 'odometer': 60986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 910895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ad896d-e91c-5202-9835-1dfea3e44517/62ad896d-e91c-5202-9835-1dfea3e44517_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 946293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dk/d5bf98d50168480b933868edb6533e17/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 X 1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S EAT8 FEEL AT',
 'vin': None,
 'year': 2023}
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982355%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [ayvens.be] INFO: Saving data for 1982355: {'created_time': 1774478836.0746, 'last_price_update_time': 1774478836.074629, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982355') HTTP/1.1" 204 0
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [ayvens.be] INFO: Found listing with ID: 1982359
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982359%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [ayvens.be] INFO: Scrape type for 1982359: 1
2026-03-25 22:47:16 [ayvens.be] INFO: Extracting data for car ID: 1982359
2026-03-25 22:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-25 22:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with scrape type 1
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/1.jpg not downloaded yet
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/2.jpg not downloaded yet
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/3.jpg not downloaded yet
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/4.jpg not downloaded yet
2026-03-25 22:47:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/5.jpg not downloaded yet
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b79950>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/2.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/6.jpg not downloaded yet
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/7.jpg not downloaded yet
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/8.jpg not downloaded yet
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ff1d0>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/7.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff7610>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/3.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ad1650>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/10.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877d950>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/1.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2810>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/6.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ad0710>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/7.jpg saved to cache
2026-03-25 22:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28af9790>
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/9.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/9.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/10.jpg not downloaded yet
2026-03-25 22:47:17 [ayvens.be] INFO: Found listing with ID: 1982360
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982360%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [ayvens.be] INFO: Scrape type for 1982360: 1
2026-03-25 22:47:17 [ayvens.be] INFO: Extracting data for car ID: 1982360
2026-03-25 22:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-25 22:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad with scrape type 1
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/1.jpg not downloaded yet
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/2.jpg not downloaded yet
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/3.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/4.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/5.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/6.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/7.jpg not downloaded yet
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/8.jpg not downloaded yet
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa0ad0>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/10.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d66d0>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/5.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878ac50>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/2.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/9.jpg not downloaded yet
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880ac50>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/8.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4f450>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/9.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503910>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/9.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362c790>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/1.jpg saved to cache
2026-03-25 22:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881d0d0>
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/8.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/10.jpg not downloaded yet
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [ayvens.be] INFO: Found listing with ID: 1982361
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982361%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [ayvens.be] INFO: Scrape type for 1982361: 1
2026-03-25 22:47:18 [ayvens.be] INFO: Extracting data for car ID: 1982361
2026-03-25 22:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-25 22:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with scrape type 1
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/1.jpg not downloaded yet
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ac10>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/1.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/2.jpg not downloaded yet
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/3.jpg not downloaded yet
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b0650>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/3.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/4.jpg not downloaded yet
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/5.jpg not downloaded yet
2026-03-25 22:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/6.jpg not downloaded yet
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215106d0>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/10.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23655f50>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/6.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809110>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/7.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23657490>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/5.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/7.jpg not downloaded yet
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fcc50>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/4.jpg saved to cache
2026-03-25 22:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae71d0>
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/8.jpg saved to cache
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6fa50>
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/10.jpg saved to cache
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/8.jpg not downloaded yet
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/9.jpg not downloaded yet
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/10.jpg not downloaded yet
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [ayvens.be] INFO: Found listing with ID: 1982362
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982362%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [ayvens.be] INFO: Scrape type for 1982362: 1
2026-03-25 22:47:19 [ayvens.be] INFO: Extracting data for car ID: 1982362
2026-03-25 22:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-25 22:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a with scrape type 1
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/1.jpg not downloaded yet
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/2.jpg not downloaded yet
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/3.jpg not downloaded yet
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b61d0>
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/9.jpg saved to cache
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/4.jpg not downloaded yet
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bdb90>
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Febab375ca58c459d90f0ff1e70347b55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/2.jpg saved to cache
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308
2026-03-25 22:47:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e96b9b1a-8274-5af2-9c5c-b5cb8890b308, skipping ID generation
2026-03-25 22:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with scrape type 1
2026-03-25 22:47:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e96b9b1a-8274-5af2-9c5c-b5cb8890b308 sending to next pipeline
2026-03-25 22:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e96b9b1a-8274-5af2-9c5c-b5cb8890b308, identifier: 1982359
2026-03-25 22:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-25 22:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359
2026-03-25 22:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e96b9b1a-8274-5af2-9c5c-b5cb8890b308 with identifier: 1982359 to the API
2026-03-25 22:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e96b9b1a-8274-5af2-9c5c-b5cb8890b308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 48727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96b9b1a-8274-5af2-9c5c-b5cb8890b308/e96b9b1a-8274-5af2-9c5c-b5cb8890b308_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/ebab375ca58c459d90f0ff1e70347b55/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982359%27 HTTP/1.1" 200 None
2026-03-25 22:47:20 [ayvens.be] INFO: Saving data for 1982359: {'created_time': 1774478840.591405, 'last_price_update_time': 1774478840.591414, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982359') HTTP/1.1" 204 0
2026-03-25 22:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/5.jpg not downloaded yet
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790690>
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/8.jpg saved to cache
2026-03-25 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a63210>
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/6.jpg saved to cache
2026-03-25 22:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fbcd0>
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/9.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae4dd0>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/7.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1a510>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/5.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee010>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/4.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/6.jpg not downloaded yet
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/7.jpg not downloaded yet
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/8.jpg not downloaded yet
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890e410>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/10.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/9.jpg not downloaded yet
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/10.jpg not downloaded yet
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23640a10>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/1.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236aff10>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/3.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288d8590>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/2.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [ayvens.be] INFO: Found listing with ID: 1982363
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982363%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [ayvens.be] INFO: Scrape type for 1982363: 1
2026-03-25 22:47:21 [ayvens.be] INFO: Extracting data for car ID: 1982363
2026-03-25 22:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-25 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with scrape type 1
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/1.jpg not downloaded yet
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/2.jpg not downloaded yet
2026-03-25 22:47:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/3.jpg not downloaded yet
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b990>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/3.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2ea50>
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252F86a460d3fdca4a45900f1a3fa5f1a98c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/1.jpg saved to cache
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad
2026-03-25 22:47:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5617fe04-6629-5d82-9a7e-a97abf42e2ad, skipping ID generation
2026-03-25 22:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad with scrape type 1
2026-03-25 22:47:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5617fe04-6629-5d82-9a7e-a97abf42e2ad sending to next pipeline
2026-03-25 22:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5617fe04-6629-5d82-9a7e-a97abf42e2ad, identifier: 1982360
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4c290>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/4.jpg saved to cache
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288d87d0>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/5.jpg saved to cache
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-25 22:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360
2026-03-25 22:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5617fe04-6629-5d82-9a7e-a97abf42e2ad with identifier: 1982360 to the API
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5617fe04-6629-5d82-9a7e-a97abf42e2ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 41905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5617fe04-6629-5d82-9a7e-a97abf42e2ad/5617fe04-6629-5d82-9a7e-a97abf42e2ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/86a460d3fdca4a45900f1a3fa5f1a98c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW DCT',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18I 100KW DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982360%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [ayvens.be] INFO: Saving data for 1982360: {'created_time': 1774478842.565642, 'last_price_update_time': 1774478842.565652, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982360') HTTP/1.1" 204 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/4.jpg not downloaded yet
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/5.jpg not downloaded yet
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f1810>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/7.jpg saved to cache
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/6.jpg not downloaded yet
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/7.jpg not downloaded yet
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23626310>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/8.jpg saved to cache
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364a950>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/9.jpg saved to cache
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/8.jpg not downloaded yet
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28740ad0>
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/10.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64be50>
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/6.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/9.jpg not downloaded yet
2026-03-25 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881ae10>
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/1.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28818290>
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F9c814354627c478ebc8ba1eeb2645b54%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/2.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0
2026-03-25 22:47:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0, skipping ID generation
2026-03-25 22:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with scrape type 1
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 sending to next pipeline
2026-03-25 22:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0, identifier: 1982361
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c126d0>
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/3.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/10.jpg not downloaded yet
2026-03-25 22:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-25 22:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361
2026-03-25 22:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62ce4bcb-b26f-52f9-8101-2847d7dcc6a0 with identifier: 1982361 to the API
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '62ce4bcb-b26f-52f9-8101-2847d7dcc6a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 182827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62ce4bcb-b26f-52f9-8101-2847d7dcc6a0/62ce4bcb-b26f-52f9-8101-2847d7dcc6a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/9c814354627c478ebc8ba1eeb2645b54/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 180 S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982361%27 HTTP/1.1" 200 None
2026-03-25 22:47:23 [ayvens.be] INFO: Saving data for 1982361: {'created_time': 1774478843.848242, 'last_price_update_time': 1774478843.848251, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982361') HTTP/1.1" 204 0
2026-03-25 22:47:23 [ayvens.be] INFO: Found listing with ID: 1982364
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982364%27 HTTP/1.1" 200 None
2026-03-25 22:47:23 [ayvens.be] INFO: Scrape type for 1982364: 1
2026-03-25 22:47:23 [ayvens.be] INFO: Extracting data for car ID: 1982364
2026-03-25 22:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-25 22:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with scrape type 1
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/1.jpg not downloaded yet
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f7b90>
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/6.jpg saved to cache
2026-03-25 22:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/2.jpg not downloaded yet
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/3.jpg not downloaded yet
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/4.jpg not downloaded yet
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/5.jpg not downloaded yet
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/6.jpg not downloaded yet
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/7.jpg not downloaded yet
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/8.jpg not downloaded yet
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23624d50>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/7.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa0510>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/5.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/9.jpg not downloaded yet
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ad3290>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/4.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28816290>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/8.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e0f50>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/2.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814c10>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/7.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/10.jpg not downloaded yet
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [ayvens.be] INFO: Found listing with ID: 1982365
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982365%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [ayvens.be] INFO: Scrape type for 1982365: 1
2026-03-25 22:47:24 [ayvens.be] INFO: Extracting data for car ID: 1982365
2026-03-25 22:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-25 22:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with scrape type 1
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/1.jpg not downloaded yet
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b789d0>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/2.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361fa10>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/9.jpg saved to cache
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/2.jpg not downloaded yet
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/3.jpg not downloaded yet
2026-03-25 22:47:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e86d0>
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/1.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22590>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/4.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515ad0>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/3.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/4.jpg not downloaded yet
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367ded0>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/7.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc59d0>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/5.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/5.jpg not downloaded yet
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/6.jpg not downloaded yet
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cbfd0>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F407163c0d4414ac29185bc0d1a796cf0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/10.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a
2026-03-25 22:47:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ca879a9-f76e-522e-8f3d-0187d2220f2a, skipping ID generation
2026-03-25 22:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a with scrape type 1
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ca879a9-f76e-522e-8f3d-0187d2220f2a sending to next pipeline
2026-03-25 22:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ca879a9-f76e-522e-8f3d-0187d2220f2a, identifier: 1982362
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b3805cc50>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/8.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d6dd0>
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/6.jpg saved to cache
2026-03-25 22:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-25 22:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362
2026-03-25 22:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ca879a9-f76e-522e-8f3d-0187d2220f2a with identifier: 1982362 to the API
2026-03-25 22:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3ca879a9-f76e-522e-8f3d-0187d2220f2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 190523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca879a9-f76e-522e-8f3d-0187d2220f2a/3ca879a9-f76e-522e-8f3d-0187d2220f2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/407163c0d4414ac29185bc0d1a796cf0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 216DA GRAN COUPE',
 'transmission': 'automatic',
 'trim': '1.5 216DA GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982362%27 HTTP/1.1" 200 None
2026-03-25 22:47:26 [ayvens.be] INFO: Saving data for 1982362: {'created_time': 1774478846.236708, 'last_price_update_time': 1774478846.23672, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982362') HTTP/1.1" 204 0
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/7.jpg not downloaded yet
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/8.jpg not downloaded yet
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d6590>
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/9.jpg saved to cache
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/9.jpg not downloaded yet
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/10.jpg not downloaded yet
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b6290>
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/10.jpg saved to cache
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b4490>
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252F3e32b24d390848758ef517c6edfd7d22%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/6.jpg saved to cache
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0
2026-03-25 22:47:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0, skipping ID generation
2026-03-25 22:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with scrape type 1
2026-03-25 22:47:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 sending to next pipeline
2026-03-25 22:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0, identifier: 1982363
2026-03-25 22:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-25 22:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363
2026-03-25 22:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2caed4b9-cbe4-5dab-9099-7dd1f501f2c0 with identifier: 1982363 to the API
2026-03-25 22:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '2caed4b9-cbe4-5dab-9099-7dd1f501f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'VITO',
 'odometer': 223946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2caed4b9-cbe4-5dab-9099-7dd1f501f2c0/2caed4b9-cbe4-5dab-9099-7dd1f501f2c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/3e32b24d390848758ef517c6edfd7d22/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ VITO 2.0 100KW 114 CDI L2',
 'transmission': 'manual',
 'trim': '2.0 100KW 114 CDI L2',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982363%27 HTTP/1.1" 200 None
2026-03-25 22:47:27 [ayvens.be] INFO: Saving data for 1982363: {'created_time': 1774478847.560597, 'last_price_update_time': 1774478847.560606, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982363') HTTP/1.1" 204 0
2026-03-25 22:47:27 [ayvens.be] INFO: Found listing with ID: 1982366
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982366%27 HTTP/1.1" 200 None
2026-03-25 22:47:27 [ayvens.be] INFO: Scrape type for 1982366: 1
2026-03-25 22:47:27 [ayvens.be] INFO: Extracting data for car ID: 1982366
2026-03-25 22:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-25 22:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with scrape type 1
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/1.jpg not downloaded yet
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a98d0>
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/2.jpg saved to cache
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/2.jpg not downloaded yet
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a363910>
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/5.jpg saved to cache
2026-03-25 22:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b4150>
2026-03-25 22:47:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/3.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e7990>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/1.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/3.jpg not downloaded yet
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/4.jpg not downloaded yet
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/5.jpg not downloaded yet
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/6.jpg not downloaded yet
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/7.jpg not downloaded yet
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/8.jpg not downloaded yet
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/9.jpg not downloaded yet
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/10.jpg not downloaded yet
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925b10>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/9.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b290>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/5.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:28 [ayvens.be] INFO: Found listing with ID: 1982367
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982367%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [ayvens.be] INFO: Scrape type for 1982367: 1
2026-03-25 22:47:28 [ayvens.be] INFO: Extracting data for car ID: 1982367
2026-03-25 22:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-25 22:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f410232-5e8f-5468-b97f-fcbec566c596 with scrape type 1
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/1.jpg not downloaded yet
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a35f710>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/7.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/2.jpg not downloaded yet
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/3.jpg not downloaded yet
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc4ad0>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/2.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23641e90>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/1.jpg saved to cache
2026-03-25 22:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cb890>
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/6.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839fed0>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/10.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a394090>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/8.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/4.jpg not downloaded yet
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/5.jpg not downloaded yet
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/6.jpg not downloaded yet
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/7.jpg not downloaded yet
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/8.jpg not downloaded yet
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/9.jpg not downloaded yet
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/10.jpg not downloaded yet
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362d410>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/6.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f210>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/5.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:29 [ayvens.be] INFO: Found listing with ID: 1982368
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982368%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [ayvens.be] INFO: Scrape type for 1982368: 1
2026-03-25 22:47:29 [ayvens.be] INFO: Extracting data for car ID: 1982368
2026-03-25 22:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-25 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with scrape type 1
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/1.jpg not downloaded yet
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288163d0>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F5fcb7491c8aa4b0cb396f63eeb8fd1be%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/4.jpg saved to cache
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5
2026-03-25 22:47:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5, skipping ID generation
2026-03-25 22:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with scrape type 1
2026-03-25 22:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 sending to next pipeline
2026-03-25 22:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5, identifier: 1982364
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2abf86d0>
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/7.jpg saved to cache
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627d50>
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/4.jpg saved to cache
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7210>
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/8.jpg saved to cache
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/2.jpg not downloaded yet
2026-03-25 22:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-25 22:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364
2026-03-25 22:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5acb7406-40bb-51e1-995c-1de2c3f8a8c5 with identifier: 1982364 to the API
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5acb7406-40bb-51e1-995c-1de2c3f8a8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 209411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 880264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acb7406-40bb-51e1-995c-1de2c3f8a8c5/5acb7406-40bb-51e1-995c-1de2c3f8a8c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 964463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/5fcb7491c8aa4b0cb396f63eeb8fd1be/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY 2.0TDI 55KW BMT CARGO',
 'transmission': 'manual',
 'trim': '2.0TDI 55KW BMT CARGO',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982364%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [ayvens.be] INFO: Saving data for 1982364: {'created_time': 1774478850.585558, 'last_price_update_time': 1774478850.585567, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982364') HTTP/1.1" 204 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/3.jpg not downloaded yet
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b38065690>
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/4.jpg saved to cache
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603810>
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/3.jpg saved to cache
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/4.jpg not downloaded yet
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/5.jpg not downloaded yet
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/6.jpg not downloaded yet
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/7.jpg not downloaded yet
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/8.jpg not downloaded yet
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/9.jpg not downloaded yet
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7b5d0>
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/3.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/10.jpg not downloaded yet
2026-03-25 22:47:31 [ayvens.be] INFO: Found listing with ID: 1982369
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982369%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [ayvens.be] INFO: Scrape type for 1982369: 1
2026-03-25 22:47:31 [ayvens.be] INFO: Extracting data for car ID: 1982369
2026-03-25 22:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-25 22:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc with scrape type 1
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/1.jpg not downloaded yet
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/2.jpg not downloaded yet
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a945d0>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/10.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876df10>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/1.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1a750>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/2.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917a10>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/1.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7cc10>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/10.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1b510>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/5.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae5b90>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/4.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/3.jpg not downloaded yet
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/4.jpg not downloaded yet
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/5.jpg not downloaded yet
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/6.jpg not downloaded yet
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/7.jpg not downloaded yet
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/8.jpg not downloaded yet
2026-03-25 22:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a7c50>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/1.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/9.jpg not downloaded yet
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215281d0>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/2.jpg saved to cache
2026-03-25 22:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7b110>
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/9.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876f890>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/9.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28765c10>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/3.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a958d0>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/8.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876f650>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/4.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a97a10>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/10.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/10.jpg not downloaded yet
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [ayvens.be] INFO: Found listing with ID: 1982370
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982370%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [ayvens.be] INFO: Scrape type for 1982370: 1
2026-03-25 22:47:32 [ayvens.be] INFO: Extracting data for car ID: 1982370
2026-03-25 22:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-25 22:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with scrape type 1
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/1.jpg not downloaded yet
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23657c10>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/3.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/2.jpg not downloaded yet
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/3.jpg not downloaded yet
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/4.jpg not downloaded yet
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bab3d0>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/4.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ac310>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/2.jpg saved to cache
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/5.jpg not downloaded yet
2026-03-25 22:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/6.jpg not downloaded yet
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924290>
2026-03-25 22:47:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/10.jpg saved to cache
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c3b90>
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/7.jpg saved to cache
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5d550>
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/6.jpg saved to cache
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ea750>
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fb129bdbb54b149db92df4668f4bc9f94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/5.jpg saved to cache
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f410232-5e8f-5468-b97f-fcbec566c596
2026-03-25 22:47:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f410232-5e8f-5468-b97f-fcbec566c596, skipping ID generation
2026-03-25 22:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f410232-5e8f-5468-b97f-fcbec566c596 with scrape type 1
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f410232-5e8f-5468-b97f-fcbec566c596 sending to next pipeline
2026-03-25 22:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5f410232-5e8f-5468-b97f-fcbec566c596, identifier: 1982367
2026-03-25 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/7.jpg not downloaded yet
2026-03-25 22:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-25 22:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367
2026-03-25 22:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5f410232-5e8f-5468-b97f-fcbec566c596 with identifier: 1982367 to the API
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5f410232-5e8f-5468-b97f-fcbec566c596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 242195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f410232-5e8f-5468-b97f-fcbec566c596/5f410232-5e8f-5468-b97f-fcbec566c596_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/b129bdbb54b149db92df4668f4bc9f94/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982367%27 HTTP/1.1" 200 None
2026-03-25 22:47:33 [ayvens.be] INFO: Saving data for 1982367: {'created_time': 1774478853.964136, 'last_price_update_time': 1774478853.964145, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982367') HTTP/1.1" 204 0
2026-03-25 22:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/8.jpg not downloaded yet
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/9.jpg not downloaded yet
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1cc90>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/8.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e2ed0>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/2.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669a90>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/7.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/10.jpg not downloaded yet
2026-03-25 22:47:34 [ayvens.be] INFO: Found listing with ID: 1982371
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982371%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [ayvens.be] INFO: Scrape type for 1982371: 1
2026-03-25 22:47:34 [ayvens.be] INFO: Extracting data for car ID: 1982371
2026-03-25 22:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-25 22:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with scrape type 1
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/1.jpg not downloaded yet
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cf190>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/6.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/2.jpg not downloaded yet
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/3.jpg not downloaded yet
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/4.jpg not downloaded yet
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e403d0>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/9.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516ad0>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/8.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccd50>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/3.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cb510>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/9.jpg saved to cache
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/5.jpg not downloaded yet
2026-03-25 22:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/6.jpg not downloaded yet
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e8fd0>
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/1.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23611050>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/4.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/7.jpg not downloaded yet
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/8.jpg not downloaded yet
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/9.jpg not downloaded yet
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668210>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/10.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccd50>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/8.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ca3d0>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/1.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/10.jpg not downloaded yet
2026-03-25 22:47:35 [ayvens.be] INFO: Found listing with ID: 1982372
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982372%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [ayvens.be] INFO: Scrape type for 1982372: 1
2026-03-25 22:47:35 [ayvens.be] INFO: Extracting data for car ID: 1982372
2026-03-25 22:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-25 22:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e223a-a958-5530-a528-f172915a1616 with scrape type 1
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/1.jpg not downloaded yet
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151add0>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/7.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ed390>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/2.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d9bd0>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/4.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23655490>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/3.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877e150>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/6.jpg saved to cache
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/2.jpg not downloaded yet
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/3.jpg not downloaded yet
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/4.jpg not downloaded yet
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/5.jpg not downloaded yet
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/6.jpg not downloaded yet
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/7.jpg not downloaded yet
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f8690>
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/7.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/8.jpg not downloaded yet
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288eb950>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/6.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/9.jpg not downloaded yet
2026-03-25 22:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/10.jpg not downloaded yet
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64a5d0>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/1.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7c10>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/5.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cabd0>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd74719a8348b4a5b8d11d5c76dfdaa7e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/5.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc
2026-03-25 22:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 654038e2-6432-5b5b-9e3f-65c9d3e967dc, skipping ID generation
2026-03-25 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc with scrape type 1
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 654038e2-6432-5b5b-9e3f-65c9d3e967dc sending to next pipeline
2026-03-25 22:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 654038e2-6432-5b5b-9e3f-65c9d3e967dc, identifier: 1982369
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21521fd0>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/9.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28afabd0>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/10.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64a410>
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F6e1abb947c2c404cac5f6f43b11c7531%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/8.jpg saved to cache
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9
2026-03-25 22:47:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9, skipping ID generation
2026-03-25 22:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with scrape type 1
2026-03-25 22:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 sending to next pipeline
2026-03-25 22:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9, identifier: 1982370
2026-03-25 22:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-25 22:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369
2026-03-25 22:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 654038e2-6432-5b5b-9e3f-65c9d3e967dc with identifier: 1982369 to the API
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '654038e2-6432-5b5b-9e3f-65c9d3e967dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 91533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_654038e2-6432-5b5b-9e3f-65c9d3e967dc/654038e2-6432-5b5b-9e3f-65c9d3e967dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d74719a8348b4a5b8d11d5c76dfdaa7e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982369%27 HTTP/1.1" 200 None
2026-03-25 22:47:37 [ayvens.be] INFO: Saving data for 1982369: {'created_time': 1774478857.462004, 'last_price_update_time': 1774478857.462013, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982369') HTTP/1.1" 204 0
2026-03-25 22:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-25 22:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370
2026-03-25 22:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c34ad44-3e1b-50dd-a354-6c883c1ddeb9 with identifier: 1982370 to the API
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c34ad44-3e1b-50dd-a354-6c883c1ddeb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 85585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 943433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c34ad44-3e1b-50dd-a354-6c883c1ddeb9/3c34ad44-3e1b-50dd-a354-6c883c1ddeb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 895176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/6e1abb947c2c404cac5f6f43b11c7531/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982370%27 HTTP/1.1" 200 None
2026-03-25 22:47:37 [ayvens.be] INFO: Saving data for 1982370: {'created_time': 1774478857.936936, 'last_price_update_time': 1774478857.936961, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982370') HTTP/1.1" 204 0
2026-03-25 22:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:37 [ayvens.be] INFO: Found listing with ID: 1982373
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982373%27 HTTP/1.1" 200 None
2026-03-25 22:47:37 [ayvens.be] INFO: Scrape type for 1982373: 1
2026-03-25 22:47:37 [ayvens.be] INFO: Extracting data for car ID: 1982373
2026-03-25 22:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-25 22:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785dd859-af55-5763-9b46-06d6f50a3d70 with scrape type 1
2026-03-25 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/1.jpg not downloaded yet
2026-03-25 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/2.jpg not downloaded yet
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215250d0>
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/4.jpg saved to cache
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/3.jpg not downloaded yet
2026-03-25 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/4.jpg not downloaded yet
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8b90>
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/3.jpg saved to cache
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28816810>
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/5.jpg saved to cache
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a4790>
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F931fb8edee8d4f2ba7f7ac0aca315493%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/5.jpg saved to cache
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd
2026-03-25 22:47:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd, skipping ID generation
2026-03-25 22:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with scrape type 1
2026-03-25 22:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd sending to next pipeline
2026-03-25 22:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd, identifier: 1982368
2026-03-25 22:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-25 22:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368
2026-03-25 22:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0efb8a44-b42c-5a49-beba-3efd9e9a2cdd with identifier: 1982368 to the API
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '0efb8a44-b42c-5a49-beba-3efd9e9a2cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL - 2016',
 'odometer': 156193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0efb8a44-b42c-5a49-beba-3efd9e9a2cdd/0efb8a44-b42c-5a49-beba-3efd9e9a2cdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/931fb8edee8d4f2ba7f7ac0aca315493/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN DIESEL - 2016 2.0 TDi SCR Comfortline (EU6.2)',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Comfortline (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982368%27 HTTP/1.1" 200 None
2026-03-25 22:47:38 [ayvens.be] INFO: Saving data for 1982368: {'created_time': 1774478858.931639, 'last_price_update_time': 1774478858.93165, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982368') HTTP/1.1" 204 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/5.jpg not downloaded yet
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/6.jpg not downloaded yet
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68ad0>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/2.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28904d50>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/7.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369da90>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/6.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/7.jpg not downloaded yet
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/8.jpg not downloaded yet
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28816250>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/8.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28774310>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/1.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/9.jpg not downloaded yet
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/10.jpg not downloaded yet
2026-03-25 22:47:39 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0f90>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/3.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a608d0>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/4.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cd250>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/2.jpg saved to cache
2026-03-25 22:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28816050>
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/5.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ae10>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/10.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627e90>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/10.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364b010>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F5c8ea004dac24f139ea72a1ebb7ac4c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/9.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5
2026-03-25 22:47:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5, skipping ID generation
2026-03-25 22:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with scrape type 1
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 sending to next pipeline
2026-03-25 22:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5, identifier: 1982371
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9690>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/9.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-25 22:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371
2026-03-25 22:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5 with identifier: 1982371 to the API
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 102124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 950944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 868240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5/e8f9e6d5-ecfe-5080-ad1b-4defdd1509b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/5c8ea004dac24f139ea72a1ebb7ac4c6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982371%27 HTTP/1.1" 200 None
2026-03-25 22:47:40 [ayvens.be] INFO: Saving data for 1982371: {'created_time': 1774478860.734076, 'last_price_update_time': 1774478860.734085, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982371') HTTP/1.1" 204 0
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28af8fd0>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/4.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fdc50>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/5.jpg saved to cache
2026-03-25 22:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b7c10>
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/1.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ed650>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/3.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7e3d0>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/2.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ac890>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/7.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e41c50>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/8.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa3f90>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F26ab074f8bad4bffb0a3362f5ec41743%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/6.jpg saved to cache
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b9e223a-a958-5530-a528-f172915a1616
2026-03-25 22:47:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b9e223a-a958-5530-a528-f172915a1616, skipping ID generation
2026-03-25 22:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e223a-a958-5530-a528-f172915a1616 with scrape type 1
2026-03-25 22:47:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b9e223a-a958-5530-a528-f172915a1616 sending to next pipeline
2026-03-25 22:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b9e223a-a958-5530-a528-f172915a1616, identifier: 1982372
2026-03-25 22:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-25 22:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372
2026-03-25 22:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b9e223a-a958-5530-a528-f172915a1616 with identifier: 1982372 to the API
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8b9e223a-a958-5530-a528-f172915a1616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 69715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e223a-a958-5530-a528-f172915a1616/8b9e223a-a958-5530-a528-f172915a1616_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/26ab074f8bad4bffb0a3362f5ec41743/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982372%27 HTTP/1.1" 200 None
2026-03-25 22:47:41 [ayvens.be] INFO: Saving data for 1982372: {'created_time': 1774478861.949055, 'last_price_update_time': 1774478861.949065, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982372') HTTP/1.1" 204 0
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23647d50>
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/9.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28afbcd0>
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/6.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366a990>
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/8.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892e890>
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/7.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21522a90>
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yl%252F84579414377a463089b47a5732dd30e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/10.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 785dd859-af55-5763-9b46-06d6f50a3d70
2026-03-25 22:47:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 785dd859-af55-5763-9b46-06d6f50a3d70, skipping ID generation
2026-03-25 22:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785dd859-af55-5763-9b46-06d6f50a3d70 with scrape type 1
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 785dd859-af55-5763-9b46-06d6f50a3d70 sending to next pipeline
2026-03-25 22:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 785dd859-af55-5763-9b46-06d6f50a3d70, identifier: 1982373
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f7cd0>
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/7.jpg saved to cache
2026-03-25 22:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-25 22:47:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373
2026-03-25 22:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 785dd859-af55-5763-9b46-06d6f50a3d70 with identifier: 1982373 to the API
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'NOIR PERLA NERA',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '785dd859-af55-5763-9b46-06d6f50a3d70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 55014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_785dd859-af55-5763-9b46-06d6f50a3d70/785dd859-af55-5763-9b46-06d6f50a3d70_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 929929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yl/84579414377a463089b47a5732dd30e0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Allure',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure',
 'vin': None,
 'year': 2020}
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982373%27 HTTP/1.1" 200 None
2026-03-25 22:47:43 [ayvens.be] INFO: Saving data for 1982373: {'created_time': 1774478863.104647, 'last_price_update_time': 1774478863.104657, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982373') HTTP/1.1" 204 0
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:43 [ayvens.be] INFO: Found listing with ID: 1982374
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982374%27 HTTP/1.1" 200 None
2026-03-25 22:47:43 [ayvens.be] INFO: Scrape type for 1982374: 1
2026-03-25 22:47:43 [ayvens.be] INFO: Extracting data for car ID: 1982374
2026-03-25 22:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-25 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d057e446-aaa5-5849-b692-2eea29002f92 with scrape type 1
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/1.jpg not downloaded yet
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/2.jpg not downloaded yet
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/3.jpg not downloaded yet
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2839d250>
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F60884591d3cf4d7b9ba1a9df2fbcfc58%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/6.jpg saved to cache
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28
2026-03-25 22:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26f9dfe2-d663-518c-8fd2-7f71ec532d28, skipping ID generation
2026-03-25 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with scrape type 1
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26f9dfe2-d663-518c-8fd2-7f71ec532d28 sending to next pipeline
2026-03-25 22:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26f9dfe2-d663-518c-8fd2-7f71ec532d28, identifier: 1982366
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151a890>
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252Ff984e51735764a53a95e12ca7da29edb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/9.jpg saved to cache
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee
2026-03-25 22:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee, skipping ID generation
2026-03-25 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with scrape type 1
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d3a7b6a-cc06-5926-be1f-7f29745f83ee sending to next pipeline
2026-03-25 22:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee, identifier: 1982365
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925350>
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/5.jpg saved to cache
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64cd50>
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/7.jpg saved to cache
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bcae10>
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F4e19f5c71b38482280030d9f09919a26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/6.jpg saved to cache
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6743647-357c-5f2f-89ac-6b555c76e721
2026-03-25 22:47:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6743647-357c-5f2f-89ac-6b555c76e721, skipping ID generation
2026-03-25 22:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6743647-357c-5f2f-89ac-6b555c76e721 with scrape type 1
2026-03-25 22:47:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6743647-357c-5f2f-89ac-6b555c76e721 sending to next pipeline
2026-03-25 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6743647-357c-5f2f-89ac-6b555c76e721, identifier: 1982356
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d34410>
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F5b7239c0272b47859341a31dcd8de4eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/3.jpg saved to cache
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e
2026-03-25 22:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 332e6710-3a5f-5d99-b557-eba9e7dcf17e, skipping ID generation
2026-03-25 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e with scrape type 1
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 332e6710-3a5f-5d99-b557-eba9e7dcf17e sending to next pipeline
2026-03-25 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 332e6710-3a5f-5d99-b557-eba9e7dcf17e, identifier: 1982358
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ff890>
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ff225368420a54bab97d0768415df3e40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/4.jpg saved to cache
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9b6005f-c543-5e51-80c8-6fa0585684e9
2026-03-25 22:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9b6005f-c543-5e51-80c8-6fa0585684e9, skipping ID generation
2026-03-25 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b6005f-c543-5e51-80c8-6fa0585684e9 with scrape type 1
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9b6005f-c543-5e51-80c8-6fa0585684e9 sending to next pipeline
2026-03-25 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9b6005f-c543-5e51-80c8-6fa0585684e9, identifier: 1982357
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b5310>
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F86a1bf998d384c038ae7827f04283117%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/8.jpg saved to cache
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4991c624-906d-5f9d-a369-cb66974f815b
2026-03-25 22:47:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4991c624-906d-5f9d-a369-cb66974f815b, skipping ID generation
2026-03-25 22:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4991c624-906d-5f9d-a369-cb66974f815b with scrape type 1
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4991c624-906d-5f9d-a369-cb66974f815b sending to next pipeline
2026-03-25 22:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4991c624-906d-5f9d-a369-cb66974f815b, identifier: 1982204
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/4.jpg not downloaded yet
2026-03-25 22:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-25 22:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366
2026-03-25 22:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26f9dfe2-d663-518c-8fd2-7f71ec532d28 with identifier: 1982366 to the API
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '26f9dfe2-d663-518c-8fd2-7f71ec532d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 163253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f9dfe2-d663-518c-8fd2-7f71ec532d28/26f9dfe2-d663-518c-8fd2-7f71ec532d28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/60884591d3cf4d7b9ba1a9df2fbcfc58/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982366%27 HTTP/1.1" 200 None
2026-03-25 22:47:44 [ayvens.be] INFO: Saving data for 1982366: {'created_time': 1774478864.900403, 'last_price_update_time': 1774478864.900413, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982366') HTTP/1.1" 204 0
2026-03-25 22:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-25 22:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365
2026-03-25 22:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1d3a7b6a-cc06-5926-be1f-7f29745f83ee with identifier: 1982365 to the API
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1d3a7b6a-cc06-5926-be1f-7f29745f83ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA COMBI - 2018',
 'odometer': 197844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3a7b6a-cc06-5926-be1f-7f29745f83ee/1d3a7b6a-cc06-5926-be1f-7f29745f83ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/f984e51735764a53a95e12ca7da29edb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA COMBI - 2018 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982365%27 HTTP/1.1" 200 None
2026-03-25 22:47:45 [ayvens.be] INFO: Saving data for 1982365: {'created_time': 1774478865.272644, 'last_price_update_time': 1774478865.272654, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982365') HTTP/1.1" 204 0
2026-03-25 22:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-25 22:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356
2026-03-25 22:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6743647-357c-5f2f-89ac-6b555c76e721 with identifier: 1982356 to the API
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c6743647-357c-5f2f-89ac-6b555c76e721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 77659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6743647-357c-5f2f-89ac-6b555c76e721/c6743647-357c-5f2f-89ac-6b555c76e721_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/4e19f5c71b38482280030d9f09919a26/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982356%27 HTTP/1.1" 200 None
2026-03-25 22:47:45 [ayvens.be] INFO: Saving data for 1982356: {'created_time': 1774478865.627455, 'last_price_update_time': 1774478865.627464, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982356') HTTP/1.1" 204 0
2026-03-25 22:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-25 22:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358
2026-03-25 22:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 332e6710-3a5f-5d99-b557-eba9e7dcf17e with identifier: 1982358 to the API
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '332e6710-3a5f-5d99-b557-eba9e7dcf17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 57955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 878465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 807771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_332e6710-3a5f-5d99-b557-eba9e7dcf17e/332e6710-3a5f-5d99-b557-eba9e7dcf17e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/5b7239c0272b47859341a31dcd8de4eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.4 TSI GTE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI GTE BUSINESS DSG',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982358%27 HTTP/1.1" 200 None
2026-03-25 22:47:45 [ayvens.be] INFO: Saving data for 1982358: {'created_time': 1774478865.963672, 'last_price_update_time': 1774478865.963684, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982358') HTTP/1.1" 204 0
2026-03-25 22:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-25 22:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357
2026-03-25 22:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9b6005f-c543-5e51-80c8-6fa0585684e9 with identifier: 1982357 to the API
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd9b6005f-c543-5e51-80c8-6fa0585684e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK DIESEL - 2020',
 'odometer': 73865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b6005f-c543-5e51-80c8-6fa0585684e9/d9b6005f-c543-5e51-80c8-6fa0585684e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/f225368420a54bab97d0768415df3e40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK DIESEL - 2020 30 TDi',
 'transmission': 'manual',
 'trim': '30 TDi',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982357%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [ayvens.be] INFO: Saving data for 1982357: {'created_time': 1774478866.33197, 'last_price_update_time': 1774478866.331979, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982357') HTTP/1.1" 204 0
2026-03-25 22:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4991c624-906d-5f9d-a369-cb66974f815b with identifier: 1982204
2026-03-25 22:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4991c624-906d-5f9d-a369-cb66974f815b with identifier: 1982204
2026-03-25 22:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4991c624-906d-5f9d-a369-cb66974f815b with identifier: 1982204 to the API
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '4991c624-906d-5f9d-a369-cb66974f815b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 49568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 886742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4991c624-906d-5f9d-a369-cb66974f815b/4991c624-906d-5f9d-a369-cb66974f815b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 954331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/86a1bf998d384c038ae7827f04283117/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982204%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [ayvens.be] INFO: Saving data for 1982204: {'created_time': 1774478866.663166, 'last_price_update_time': 1774478866.663177, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982204') HTTP/1.1" 204 0
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/5.jpg not downloaded yet
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/6.jpg not downloaded yet
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/7.jpg not downloaded yet
2026-03-25 22:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/8.jpg not downloaded yet
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7710>
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/7.jpg saved to cache
2026-03-25 22:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2750>
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/5.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150d1d0>
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/4.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/9.jpg not downloaded yet
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/10.jpg not downloaded yet
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f3a10>
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252F3ec9bd35df934fcb9c4f14e6484b09a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/8.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f4678f6-413e-5f1d-af94-034bf9face0e
2026-03-25 22:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f4678f6-413e-5f1d-af94-034bf9face0e, skipping ID generation
2026-03-25 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f4678f6-413e-5f1d-af94-034bf9face0e with scrape type 1
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f4678f6-413e-5f1d-af94-034bf9face0e sending to next pipeline
2026-03-25 22:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f4678f6-413e-5f1d-af94-034bf9face0e, identifier: 1982199
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc5750>
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/9.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64a610>
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/6.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514910>
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F2b3cba444e3b4a36a3a2eb7d50b1ee80%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/10.jpg saved to cache
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074
2026-03-25 22:47:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074, skipping ID generation
2026-03-25 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with scrape type 1
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 sending to next pipeline
2026-03-25 22:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074, identifier: 1982202
2026-03-25 22:47:47 [ayvens.be] INFO: Found listing with ID: 1982375
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982375%27 HTTP/1.1" 200 None
2026-03-25 22:47:47 [ayvens.be] INFO: Scrape type for 1982375: 1
2026-03-25 22:47:47 [ayvens.be] INFO: Extracting data for car ID: 1982375
2026-03-25 22:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-25 22:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1321fa06-3436-5cce-9b4b-d08e45d7298a with scrape type 1
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/1.jpg not downloaded yet
2026-03-25 22:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f4678f6-413e-5f1d-af94-034bf9face0e with identifier: 1982199
2026-03-25 22:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f4678f6-413e-5f1d-af94-034bf9face0e with identifier: 1982199
2026-03-25 22:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f4678f6-413e-5f1d-af94-034bf9face0e with identifier: 1982199 to the API
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f4678f6-413e-5f1d-af94-034bf9face0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 97773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4678f6-413e-5f1d-af94-034bf9face0e/0f4678f6-413e-5f1d-af94-034bf9face0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/3ec9bd35df934fcb9c4f14e6484b09a7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982199%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [ayvens.be] INFO: Saving data for 1982199: {'created_time': 1774478868.09226, 'last_price_update_time': 1774478868.09227, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982199') HTTP/1.1" 204 0
2026-03-25 22:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with identifier: 1982202
2026-03-25 22:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with identifier: 1982202
2026-03-25 22:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f12eb8af-8fa1-5e8e-918c-0a5ad8d28074 with identifier: 1982202 to the API
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f12eb8af-8fa1-5e8e-918c-0a5ad8d28074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 47037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f12eb8af-8fa1-5e8e-918c-0a5ad8d28074/f12eb8af-8fa1-5e8e-918c-0a5ad8d28074_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/2b3cba444e3b4a36a3a2eb7d50b1ee80/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982202%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [ayvens.be] INFO: Saving data for 1982202: {'created_time': 1774478868.416283, 'last_price_update_time': 1774478868.416293, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982202') HTTP/1.1" 204 0
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/2.jpg not downloaded yet
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/3.jpg not downloaded yet
2026-03-25 22:47:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362e710>
2026-03-25 22:47:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfef1c6620b54158bcebe0269159b9cc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/3.jpg saved to cache
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c
2026-03-25 22:47:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee80ac1a-758d-5fd7-aa2c-383a26dd401c, skipping ID generation
2026-03-25 22:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c with scrape type 1
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee80ac1a-758d-5fd7-aa2c-383a26dd401c sending to next pipeline
2026-03-25 22:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee80ac1a-758d-5fd7-aa2c-383a26dd401c, identifier: 1982201
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee80ac1a-758d-5fd7-aa2c-383a26dd401c with identifier: 1982201
2026-03-25 22:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee80ac1a-758d-5fd7-aa2c-383a26dd401c with identifier: 1982201
2026-03-25 22:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee80ac1a-758d-5fd7-aa2c-383a26dd401c with identifier: 1982201 to the API
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee80ac1a-758d-5fd7-aa2c-383a26dd401c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 69983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 896112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 949115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee80ac1a-758d-5fd7-aa2c-383a26dd401c/ee80ac1a-758d-5fd7-aa2c-383a26dd401c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 914369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfef1c6620b54158bcebe0269159b9cc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982201%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [ayvens.be] INFO: Saving data for 1982201: {'created_time': 1774478868.94389, 'last_price_update_time': 1774478868.943899, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982201') HTTP/1.1" 204 0
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/4.jpg not downloaded yet
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/5.jpg not downloaded yet
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901d2d0>
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fbb6aae144c864085b7a2c678f0028163%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/7.jpg saved to cache
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4
2026-03-25 22:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4, skipping ID generation
2026-03-25 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with scrape type 1
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 sending to next pipeline
2026-03-25 22:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4, identifier: 1982196
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883cad0>
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fcd6f1e818db147a7b1921436e707cbaa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/3.jpg saved to cache
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916
2026-03-25 22:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916, skipping ID generation
2026-03-25 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with scrape type 1
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 sending to next pipeline
2026-03-25 22:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916, identifier: 1982198
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f81d0>
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/7.jpg saved to cache
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e3b50>
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F4cc9aa1fb27a44d0949c2ae8b073115d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/6.jpg saved to cache
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e
2026-03-25 22:47:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44f9fac4-2c43-5394-97b6-25db1f4cd11e, skipping ID generation
2026-03-25 22:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e with scrape type 1
2026-03-25 22:47:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44f9fac4-2c43-5394-97b6-25db1f4cd11e sending to next pipeline
2026-03-25 22:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44f9fac4-2c43-5394-97b6-25db1f4cd11e, identifier: 1982195
2026-03-25 22:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with identifier: 1982196
2026-03-25 22:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with identifier: 1982196
2026-03-25 22:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 22ccdd89-26d1-5f1e-a8f5-c74ba07543e4 with identifier: 1982196 to the API
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '22ccdd89-26d1-5f1e-a8f5-c74ba07543e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 41189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ccdd89-26d1-5f1e-a8f5-c74ba07543e4/22ccdd89-26d1-5f1e-a8f5-c74ba07543e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/bb6aae144c864085b7a2c678f0028163/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982196%27 HTTP/1.1" 200 None
2026-03-25 22:47:49 [ayvens.be] INFO: Saving data for 1982196: {'created_time': 1774478869.853474, 'last_price_update_time': 1774478869.853484, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982196') HTTP/1.1" 204 0
2026-03-25 22:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with identifier: 1982198
2026-03-25 22:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with identifier: 1982198
2026-03-25 22:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916 with identifier: 1982198 to the API
2026-03-25 22:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 89894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 955609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 894201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916/daa3713f-5dd5-5f7c-adf4-7ee5ef6f6916_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 933606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/cd6f1e818db147a7b1921436e707cbaa/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982198%27 HTTP/1.1" 200 None
2026-03-25 22:47:50 [ayvens.be] INFO: Saving data for 1982198: {'created_time': 1774478870.161135, 'last_price_update_time': 1774478870.161144, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982198') HTTP/1.1" 204 0
2026-03-25 22:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44f9fac4-2c43-5394-97b6-25db1f4cd11e with identifier: 1982195
2026-03-25 22:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44f9fac4-2c43-5394-97b6-25db1f4cd11e with identifier: 1982195
2026-03-25 22:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44f9fac4-2c43-5394-97b6-25db1f4cd11e with identifier: 1982195 to the API
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '44f9fac4-2c43-5394-97b6-25db1f4cd11e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 52849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44f9fac4-2c43-5394-97b6-25db1f4cd11e/44f9fac4-2c43-5394-97b6-25db1f4cd11e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/4cc9aa1fb27a44d0949c2ae8b073115d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982195%27 HTTP/1.1" 200 None
2026-03-25 22:47:50 [ayvens.be] INFO: Saving data for 1982195: {'created_time': 1774478870.480702, 'last_price_update_time': 1774478870.480711, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982195') HTTP/1.1" 204 0
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/6.jpg not downloaded yet
2026-03-25 22:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e5c90>
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/7.jpg saved to cache
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28936e50>
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F4b5998e33cac4676abc2b6349b871df8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/6.jpg saved to cache
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd2cb845-455c-56dc-81b2-27635e5d6882
2026-03-25 22:47:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd2cb845-455c-56dc-81b2-27635e5d6882, skipping ID generation
2026-03-25 22:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd2cb845-455c-56dc-81b2-27635e5d6882 with scrape type 1
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd2cb845-455c-56dc-81b2-27635e5d6882 sending to next pipeline
2026-03-25 22:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd2cb845-455c-56dc-81b2-27635e5d6882, identifier: 1982194
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f610>
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/5.jpg saved to cache
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/7.jpg not downloaded yet
2026-03-25 22:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd2cb845-455c-56dc-81b2-27635e5d6882 with identifier: 1982194
2026-03-25 22:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd2cb845-455c-56dc-81b2-27635e5d6882 with identifier: 1982194
2026-03-25 22:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd2cb845-455c-56dc-81b2-27635e5d6882 with identifier: 1982194 to the API
2026-03-25 22:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd2cb845-455c-56dc-81b2-27635e5d6882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 84214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 937919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 957810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd2cb845-455c-56dc-81b2-27635e5d6882/bd2cb845-455c-56dc-81b2-27635e5d6882_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 981895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/4b5998e33cac4676abc2b6349b871df8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982194%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [ayvens.be] INFO: Saving data for 1982194: {'created_time': 1774478871.172165, 'last_price_update_time': 1774478871.172174, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982194') HTTP/1.1" 204 0
2026-03-25 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/8.jpg not downloaded yet
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb4410>
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3dc9aec542554992980699f7ec527e1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/6.jpg saved to cache
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97c8089d-d82a-5903-9a02-919379a24d24
2026-03-25 22:47:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97c8089d-d82a-5903-9a02-919379a24d24, skipping ID generation
2026-03-25 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c8089d-d82a-5903-9a02-919379a24d24 with scrape type 1
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97c8089d-d82a-5903-9a02-919379a24d24 sending to next pipeline
2026-03-25 22:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 97c8089d-d82a-5903-9a02-919379a24d24, identifier: 1982193
2026-03-25 22:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 97c8089d-d82a-5903-9a02-919379a24d24 with identifier: 1982193
2026-03-25 22:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 97c8089d-d82a-5903-9a02-919379a24d24 with identifier: 1982193
2026-03-25 22:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 97c8089d-d82a-5903-9a02-919379a24d24 with identifier: 1982193 to the API
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '97c8089d-d82a-5903-9a02-919379a24d24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 75301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97c8089d-d82a-5903-9a02-919379a24d24/97c8089d-d82a-5903-9a02-919379a24d24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3dc9aec542554992980699f7ec527e1e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982193%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [ayvens.be] INFO: Saving data for 1982193: {'created_time': 1774478871.657604, 'last_price_update_time': 1774478871.657613, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982193') HTTP/1.1" 204 0
2026-03-25 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/9.jpg not downloaded yet
2026-03-25 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/10.jpg not downloaded yet
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28935350>
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/3.jpg saved to cache
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23645010>
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/4.jpg saved to cache
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:51 [ayvens.be] INFO: Found listing with ID: 1982376
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982376%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [ayvens.be] INFO: Scrape type for 1982376: 1
2026-03-25 22:47:51 [ayvens.be] INFO: Extracting data for car ID: 1982376
2026-03-25 22:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-25 22:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d8843-27a3-5075-957d-30ca3378b5a1 with scrape type 1
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/1.jpg not downloaded yet
2026-03-25 22:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b3bd0>
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/2.jpg saved to cache
2026-03-25 22:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4e3d0>
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/1.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/2.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/3.jpg not downloaded yet
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28808e10>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/6.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/4.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/5.jpg not downloaded yet
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881aed0>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/10.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1f3d0>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/1.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/6.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/7.jpg not downloaded yet
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/8.jpg not downloaded yet
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23655050>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/8.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917110>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/7.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e8c50>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/3.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/9.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/10.jpg not downloaded yet
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236db710>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/2.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23646e50>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/10.jpg saved to cache
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [ayvens.be] INFO: Found listing with ID: 1982377
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982377%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [ayvens.be] INFO: Scrape type for 1982377: 1
2026-03-25 22:47:52 [ayvens.be] INFO: Extracting data for car ID: 1982377
2026-03-25 22:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-25 22:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with scrape type 1
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/1.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/2.jpg not downloaded yet
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/3.jpg not downloaded yet
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b91d0>
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/7.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e8e90>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/6.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a6790>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/4.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/4.jpg not downloaded yet
2026-03-25 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/5.jpg not downloaded yet
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288be210>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/5.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a4e62d0>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/8.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288be210>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/9.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cebd0>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/9.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c31d0>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1rh%252F43be95fd0214439a9f896c244735925e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/9.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d057e446-aaa5-5849-b692-2eea29002f92
2026-03-25 22:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d057e446-aaa5-5849-b692-2eea29002f92, skipping ID generation
2026-03-25 22:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d057e446-aaa5-5849-b692-2eea29002f92 with scrape type 1
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d057e446-aaa5-5849-b692-2eea29002f92 sending to next pipeline
2026-03-25 22:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d057e446-aaa5-5849-b692-2eea29002f92, identifier: 1982374
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8a90>
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F8ccf8ac381514e108832ff6c29423cd1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/10.jpg saved to cache
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1321fa06-3436-5cce-9b4b-d08e45d7298a
2026-03-25 22:47:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1321fa06-3436-5cce-9b4b-d08e45d7298a, skipping ID generation
2026-03-25 22:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1321fa06-3436-5cce-9b4b-d08e45d7298a with scrape type 1
2026-03-25 22:47:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1321fa06-3436-5cce-9b4b-d08e45d7298a sending to next pipeline
2026-03-25 22:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1321fa06-3436-5cce-9b4b-d08e45d7298a, identifier: 1982375
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/6.jpg not downloaded yet
2026-03-25 22:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-25 22:47:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374
2026-03-25 22:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d057e446-aaa5-5849-b692-2eea29002f92 with identifier: 1982374 to the API
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd057e446-aaa5-5849-b692-2eea29002f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'Berlingo',
 'odometer': 75593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1044120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d057e446-aaa5-5849-b692-2eea29002f92/d057e446-aaa5-5849-b692-2eea29002f92_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 919476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1rh/43be95fd0214439a9f896c244735925e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N Berlingo 1.6 VTi Feel',
 'transmission': 'manual',
 'trim': '1.6 VTi Feel',
 'vin': None,
 'year': 2017}
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982374%27 HTTP/1.1" 200 None
2026-03-25 22:47:54 [ayvens.be] INFO: Saving data for 1982374: {'created_time': 1774478874.453032, 'last_price_update_time': 1774478874.453045, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982374') HTTP/1.1" 204 0
2026-03-25 22:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-25 22:47:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375
2026-03-25 22:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1321fa06-3436-5cce-9b4b-d08e45d7298a with identifier: 1982375 to the API
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1321fa06-3436-5cce-9b4b-d08e45d7298a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 84866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1321fa06-3436-5cce-9b4b-d08e45d7298a/1321fa06-3436-5cce-9b4b-d08e45d7298a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/8ccf8ac381514e108832ff6c29423cd1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV Inscription DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV Inscription DCT STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982375%27 HTTP/1.1" 200 None
2026-03-25 22:47:54 [ayvens.be] INFO: Saving data for 1982375: {'created_time': 1774478874.814417, 'last_price_update_time': 1774478874.814428, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982375') HTTP/1.1" 204 0
2026-03-25 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/7.jpg not downloaded yet
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/8.jpg not downloaded yet
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21528590>
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/1.jpg saved to cache
2026-03-25 22:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f210>
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/2.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/9.jpg not downloaded yet
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/10.jpg not downloaded yet
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f0fd0>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/3.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876f350>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/6.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:55 [ayvens.be] INFO: Found listing with ID: 1982378
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982378%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [ayvens.be] INFO: Scrape type for 1982378: 1
2026-03-25 22:47:55 [ayvens.be] INFO: Extracting data for car ID: 1982378
2026-03-25 22:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-25 22:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73485618-5170-5b7a-b324-cf77a23aeb42 with scrape type 1
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/1.jpg not downloaded yet
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/2.jpg not downloaded yet
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/3.jpg not downloaded yet
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363cd50>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/7.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23601950>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/5.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21523a90>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/8.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878a2d0>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/8.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a69e90>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/7.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236009d0>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/4.jpg saved to cache
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/4.jpg not downloaded yet
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/5.jpg not downloaded yet
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368bbd0>
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/10.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f43d0>
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F9beb8cf22b0e4656b16d9200baf3c30c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/9.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 040d8843-27a3-5075-957d-30ca3378b5a1
2026-03-25 22:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 040d8843-27a3-5075-957d-30ca3378b5a1, skipping ID generation
2026-03-25 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d8843-27a3-5075-957d-30ca3378b5a1 with scrape type 1
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 040d8843-27a3-5075-957d-30ca3378b5a1 sending to next pipeline
2026-03-25 22:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040d8843-27a3-5075-957d-30ca3378b5a1, identifier: 1982376
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/6.jpg not downloaded yet
2026-03-25 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-25 22:47:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376
2026-03-25 22:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040d8843-27a3-5075-957d-30ca3378b5a1 with identifier: 1982376 to the API
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'ONYX BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '040d8843-27a3-5075-957d-30ca3378b5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 84265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_040d8843-27a3-5075-957d-30ca3378b5a1/040d8843-27a3-5075-957d-30ca3378b5a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/9beb8cf22b0e4656b16d9200baf3c30c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982376%27 HTTP/1.1" 200 None
2026-03-25 22:47:56 [ayvens.be] INFO: Saving data for 1982376: {'created_time': 1774478876.56052, 'last_price_update_time': 1774478876.56053, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982376') HTTP/1.1" 204 0
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/7.jpg not downloaded yet
2026-03-25 22:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/8.jpg not downloaded yet
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236db010>
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/3.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bb390>
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/2.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6ed90>
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/1.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876d4d0>
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F35b7923e425d44ea8690f4f4858a30c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/1.jpg saved to cache
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e
2026-03-25 22:47:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e, skipping ID generation
2026-03-25 22:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with scrape type 1
2026-03-25 22:47:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 031bae0e-f1d6-5d9f-b05e-9647d6ab036e sending to next pipeline
2026-03-25 22:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e, identifier: 1982191
2026-03-25 22:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with identifier: 1982191
2026-03-25 22:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with identifier: 1982191
2026-03-25 22:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 031bae0e-f1d6-5d9f-b05e-9647d6ab036e with identifier: 1982191 to the API
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '031bae0e-f1d6-5d9f-b05e-9647d6ab036e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_031bae0e-f1d6-5d9f-b05e-9647d6ab036e/031bae0e-f1d6-5d9f-b05e-9647d6ab036e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/35b7923e425d44ea8690f4f4858a30c3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982191%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [ayvens.be] INFO: Saving data for 1982191: {'created_time': 1774478877.415459, 'last_price_update_time': 1774478877.415469, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982191') HTTP/1.1" 204 0
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/9.jpg not downloaded yet
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/10.jpg not downloaded yet
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28904d50>
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/10.jpg saved to cache
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b4bcd0>
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/9.jpg saved to cache
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64a690>
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/6.jpg saved to cache
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:57 [ayvens.be] INFO: Found listing with ID: 1982379
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982379%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [ayvens.be] INFO: Scrape type for 1982379: 1
2026-03-25 22:47:57 [ayvens.be] INFO: Extracting data for car ID: 1982379
2026-03-25 22:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-25 22:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with scrape type 1
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/1.jpg not downloaded yet
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/2.jpg not downloaded yet
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e9750>
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/5.jpg saved to cache
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/3.jpg not downloaded yet
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/4.jpg not downloaded yet
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/5.jpg not downloaded yet
2026-03-25 22:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/6.jpg not downloaded yet
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/7.jpg not downloaded yet
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/8.jpg not downloaded yet
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb78d0>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/10.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/9.jpg not downloaded yet
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c80d0>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/1.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368e7d0>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/7.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917910>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/8.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288caa90>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/4.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/10.jpg not downloaded yet
2026-03-25 22:47:58 [ayvens.be] INFO: Found listing with ID: 1982380
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982380%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [ayvens.be] INFO: Scrape type for 1982380: 1
2026-03-25 22:47:58 [ayvens.be] INFO: Extracting data for car ID: 1982380
2026-03-25 22:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-25 22:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be621ee0-f86b-5a1b-9698-2fb276af75a5 with scrape type 1
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/1.jpg not downloaded yet
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a95590>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/7.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68690>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cf%252F11c9686aa55240149b5320959261c4e5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/8.jpg saved to cache
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e4ca93c-3b96-533a-84ee-159208cb363a
2026-03-25 22:47:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e4ca93c-3b96-533a-84ee-159208cb363a, skipping ID generation
2026-03-25 22:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4ca93c-3b96-533a-84ee-159208cb363a with scrape type 1
2026-03-25 22:47:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e4ca93c-3b96-533a-84ee-159208cb363a sending to next pipeline
2026-03-25 22:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e4ca93c-3b96-533a-84ee-159208cb363a, identifier: 1982190
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21511f90>
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252F6555731e43cd44fe99b2cff55e3511ba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/9.jpg saved to cache
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8
2026-03-25 22:47:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8, skipping ID generation
2026-03-25 22:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with scrape type 1
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 sending to next pipeline
2026-03-25 22:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8, identifier: 1982377
2026-03-25 22:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e4ca93c-3b96-533a-84ee-159208cb363a with identifier: 1982190
2026-03-25 22:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e4ca93c-3b96-533a-84ee-159208cb363a with identifier: 1982190
2026-03-25 22:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e4ca93c-3b96-533a-84ee-159208cb363a with identifier: 1982190 to the API
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e4ca93c-3b96-533a-84ee-159208cb363a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 63498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e4ca93c-3b96-533a-84ee-159208cb363a/1e4ca93c-3b96-533a-84ee-159208cb363a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cf/11c9686aa55240149b5320959261c4e5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seats_number': 1,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM 1 pl',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM 1 pl',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982190%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [ayvens.be] INFO: Saving data for 1982190: {'created_time': 1774478879.376586, 'last_price_update_time': 1774478879.376595, 'auction_closing_time': 1775037600.0}
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982190') HTTP/1.1" 204 0
2026-03-25 22:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-25 22:47:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377
2026-03-25 22:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8 with identifier: 1982377 to the API
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 162296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8/e22ac190-a7f9-5fcf-8ba0-d3a47ae8acc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/6555731e43cd44fe99b2cff55e3511ba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982377%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [ayvens.be] INFO: Saving data for 1982377: {'created_time': 1774478879.74978, 'last_price_update_time': 1774478879.749791, 'auction_closing_time': 1774942200.0}
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982377') HTTP/1.1" 204 0
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/2.jpg not downloaded yet
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/3.jpg not downloaded yet
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/4.jpg not downloaded yet
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/5.jpg not downloaded yet
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/6.jpg not downloaded yet
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/7.jpg not downloaded yet
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/8.jpg not downloaded yet
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215209d0>
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/5.jpg saved to cache
2026-03-25 22:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a96110>
2026-03-25 22:47:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/3.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/9.jpg not downloaded yet
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0fa50>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/4.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23600d10>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/2.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884bad0>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/7.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/10.jpg not downloaded yet
2026-03-25 22:48:00 [ayvens.be] INFO: Found listing with ID: 1982381
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982381%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [ayvens.be] INFO: Scrape type for 1982381: 1
2026-03-25 22:48:00 [ayvens.be] INFO: Extracting data for car ID: 1982381
2026-03-25 22:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with identifier: 1982381
2026-03-25 22:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with scrape type 1
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/1.jpg not downloaded yet
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cccd0>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/1.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236dad90>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/6.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23649390>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/8.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/2.jpg not downloaded yet
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/3.jpg not downloaded yet
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/4.jpg not downloaded yet
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/5.jpg not downloaded yet
2026-03-25 22:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/6.jpg not downloaded yet
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/7.jpg not downloaded yet
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28764410>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/2.jpg saved to cache
2026-03-25 22:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ba9590>
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/1.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ef1d0>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/10.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/8.jpg not downloaded yet
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/9.jpg not downloaded yet
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/10.jpg not downloaded yet
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d5bd0>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fecc2833521a14b0f9e1248d8f581b1d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/9.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73485618-5170-5b7a-b324-cf77a23aeb42
2026-03-25 22:48:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73485618-5170-5b7a-b324-cf77a23aeb42, skipping ID generation
2026-03-25 22:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73485618-5170-5b7a-b324-cf77a23aeb42 with scrape type 1
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73485618-5170-5b7a-b324-cf77a23aeb42 sending to next pipeline
2026-03-25 22:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73485618-5170-5b7a-b324-cf77a23aeb42, identifier: 1982378
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688190>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/4.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac6fd0>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/3.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28740f50>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/9.jpg saved to cache
2026-03-25 22:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28915bd0>
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/10.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-25 22:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378
2026-03-25 22:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73485618-5170-5b7a-b324-cf77a23aeb42 with identifier: 1982378 to the API
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '73485618-5170-5b7a-b324-cf77a23aeb42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 180867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73485618-5170-5b7a-b324-cf77a23aeb42/73485618-5170-5b7a-b324-cf77a23aeb42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/ecc2833521a14b0f9e1248d8f581b1d3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982378%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [ayvens.be] INFO: Saving data for 1982378: {'created_time': 1774478882.360886, 'last_price_update_time': 1774478882.360895, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982378') HTTP/1.1" 204 0
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [ayvens.be] INFO: Found listing with ID: 1982382
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982382%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [ayvens.be] INFO: Scrape type for 1982382: 1
2026-03-25 22:48:02 [ayvens.be] INFO: Extracting data for car ID: 1982382
2026-03-25 22:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-25 22:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb1147c-3a18-55bb-b58c-df65ea141be6 with scrape type 1
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/1.jpg not downloaded yet
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/2.jpg not downloaded yet
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7db90>
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/1.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/3.jpg not downloaded yet
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/4.jpg not downloaded yet
2026-03-25 22:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f9310>
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/10.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0b50>
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/7.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364a190>
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/2.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236efa50>
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/6.jpg saved to cache
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/5.jpg not downloaded yet
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/6.jpg not downloaded yet
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/7.jpg not downloaded yet
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364ad10>
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/5.jpg saved to cache
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0cad0>
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252Fc58d945d66f846ae96fde73207cd0d35%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/8.jpg saved to cache
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810
2026-03-25 22:48:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810, skipping ID generation
2026-03-25 22:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with scrape type 1
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 sending to next pipeline
2026-03-25 22:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810, identifier: 1982379
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a35f010>
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/9.jpg saved to cache
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-25 22:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379
2026-03-25 22:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5a19ac83-5fc0-5b35-aa5b-cefe01aa0810 with identifier: 1982379 to the API
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '5a19ac83-5fc0-5b35-aa5b-cefe01aa0810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 157744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a19ac83-5fc0-5b35-aa5b-cefe01aa0810/5a19ac83-5fc0-5b35-aa5b-cefe01aa0810_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/c58d945d66f846ae96fde73207cd0d35/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982379%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [ayvens.be] INFO: Saving data for 1982379: {'created_time': 1774478883.737769, 'last_price_update_time': 1774478883.737787, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982379') HTTP/1.1" 204 0
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/8.jpg not downloaded yet
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/9.jpg not downloaded yet
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/10.jpg not downloaded yet
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [ayvens.be] INFO: Found listing with ID: 1982383
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982383%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [ayvens.be] INFO: Scrape type for 1982383: 1
2026-03-25 22:48:03 [ayvens.be] INFO: Extracting data for car ID: 1982383
2026-03-25 22:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-25 22:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99079dac-8be6-5408-973e-703de7a75c32 with scrape type 1
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/1.jpg not downloaded yet
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/2.jpg not downloaded yet
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ba8790>
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/1.jpg saved to cache
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/3.jpg not downloaded yet
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/4.jpg not downloaded yet
2026-03-25 22:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/5.jpg not downloaded yet
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28915fd0>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/10.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23643450>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/2.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23644d50>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/3.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad550>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/6.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d6310>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/7.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876fd10>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/8.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/6.jpg not downloaded yet
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/7.jpg not downloaded yet
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848ad0>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/8.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/8.jpg not downloaded yet
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/9.jpg not downloaded yet
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/10.jpg not downloaded yet
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a355250>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/10.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7c90>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/6.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ad4d0>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/9.jpg saved to cache
2026-03-25 22:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc44d0>
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/1.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28792750>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/7.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28394e10>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/5.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [ayvens.be] INFO: Found listing with ID: 1982384
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982384%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [ayvens.be] INFO: Scrape type for 1982384: 1
2026-03-25 22:48:05 [ayvens.be] INFO: Extracting data for car ID: 1982384
2026-03-25 22:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-25 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with scrape type 1
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/1.jpg not downloaded yet
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/2.jpg not downloaded yet
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/3.jpg not downloaded yet
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/4.jpg not downloaded yet
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/5.jpg not downloaded yet
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/6.jpg not downloaded yet
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926990>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/2.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ed6d0>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/3.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/7.jpg not downloaded yet
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/8.jpg not downloaded yet
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/9.jpg not downloaded yet
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fa810>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/7.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874bd10>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/4.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1c910>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/5.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1cd50>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/6.jpg saved to cache
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/10.jpg not downloaded yet
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:05 [ayvens.be] INFO: Found listing with ID: 1982385
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982385%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [ayvens.be] INFO: Scrape type for 1982385: 1
2026-03-25 22:48:05 [ayvens.be] INFO: Extracting data for car ID: 1982385
2026-03-25 22:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-25 22:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6b1966c-b078-5117-a3fc-cee0c2070ee8 with scrape type 1
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/1.jpg not downloaded yet
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883f0d0>
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/9.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236da210>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/8.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/2.jpg not downloaded yet
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/3.jpg not downloaded yet
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/4.jpg not downloaded yet
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa64d0>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/5.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e1410>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/3.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/5.jpg not downloaded yet
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/6.jpg not downloaded yet
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21517e50>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/6.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a360210>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/1.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/7.jpg not downloaded yet
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/8.jpg not downloaded yet
2026-03-25 22:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/9.jpg not downloaded yet
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368be50>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/2.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28791750>
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8e2ed497209745b291cc7eee5f0317eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/4.jpg saved to cache
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6
2026-03-25 22:48:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6, skipping ID generation
2026-03-25 22:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with scrape type 1
2026-03-25 22:48:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 sending to next pipeline
2026-03-25 22:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6, identifier: 1982381
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b5910>
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/4.jpg saved to cache
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23689710>
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fef7f59197e9342cb9f414ab9847d718b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/10.jpg saved to cache
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cb1147c-3a18-55bb-b58c-df65ea141be6
2026-03-25 22:48:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cb1147c-3a18-55bb-b58c-df65ea141be6, skipping ID generation
2026-03-25 22:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb1147c-3a18-55bb-b58c-df65ea141be6 with scrape type 1
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cb1147c-3a18-55bb-b58c-df65ea141be6 sending to next pipeline
2026-03-25 22:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8cb1147c-3a18-55bb-b58c-df65ea141be6, identifier: 1982382
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cd190>
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/1.jpg saved to cache
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7790>
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/2.jpg saved to cache
2026-03-25 22:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with identifier: 1982381
2026-03-25 22:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with identifier: 1982381
2026-03-25 22:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 001a9df4-ab3f-51e4-b2d6-4041fa5467b6 with identifier: 1982381 to the API
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '001a9df4-ab3f-51e4-b2d6-4041fa5467b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLA DIESEL (H247)',
 'odometer': 121668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001a9df4-ab3f-51e4-b2d6-4041fa5467b6/001a9df4-ab3f-51e4-b2d6-4041fa5467b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8e2ed497209745b291cc7eee5f0317eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLA DIESEL (H247) GLA 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLA 180 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982381%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [ayvens.be] INFO: Saving data for 1982381: {'created_time': 1774478888.000506, 'last_price_update_time': 1774478888.000515, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982381') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-25 22:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382
2026-03-25 22:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8cb1147c-3a18-55bb-b58c-df65ea141be6 with identifier: 1982382 to the API
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8cb1147c-3a18-55bb-b58c-df65ea141be6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 143466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 875287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb1147c-3a18-55bb-b58c-df65ea141be6/8cb1147c-3a18-55bb-b58c-df65ea141be6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/ef7f59197e9342cb9f414ab9847d718b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 316DA (90KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) BERLINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982382%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [ayvens.be] INFO: Saving data for 1982382: {'created_time': 1774478888.464472, 'last_price_update_time': 1774478888.464481, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982382') HTTP/1.1" 204 0
2026-03-25 22:48:08 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at -3 pages/min), scraped 79 items (at 45 items/min)
2026-03-25 22:48:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/10.jpg not downloaded yet
2026-03-25 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:08 [ayvens.be] INFO: Found listing with ID: 1982386
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982386%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [ayvens.be] INFO: Scrape type for 1982386: 1
2026-03-25 22:48:08 [ayvens.be] INFO: Extracting data for car ID: 1982386
2026-03-25 22:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-25 22:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd22d27-98be-52d3-b256-0d95b317e4be with scrape type 1
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/1.jpg not downloaded yet
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7f4d0>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/10.jpg saved to cache
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23602350>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/3.jpg saved to cache
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368c410>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/5.jpg saved to cache
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362e390>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/4.jpg saved to cache
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/2.jpg not downloaded yet
2026-03-25 22:48:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/3.jpg not downloaded yet
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368bb10>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/9.jpg saved to cache
2026-03-25 22:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a361610>
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/6.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/4.jpg not downloaded yet
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/5.jpg not downloaded yet
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4110>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/10.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c2b50>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/2.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e8310>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/7.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/6.jpg not downloaded yet
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/7.jpg not downloaded yet
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/8.jpg not downloaded yet
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23693310>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/3.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825f10>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/4.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289fad90>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/1.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/9.jpg not downloaded yet
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/10.jpg not downloaded yet
2026-03-25 22:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368dc90>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F6e164d4fbad8487984552fd691cb0d68%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/8.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae
2026-03-25 22:48:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae, skipping ID generation
2026-03-25 22:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with scrape type 1
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2648bf2-7702-5d3b-9ea0-2ef3b30177ae sending to next pipeline
2026-03-25 22:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae, identifier: 1982384
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215153d0>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/9.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc5f10>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/7.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28827e90>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/5.jpg saved to cache
2026-03-25 22:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287421d0>
2026-03-25 22:48:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/6.jpg saved to cache
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:10 [ayvens.be] INFO: Found listing with ID: 1982387
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982387%27 HTTP/1.1" 200 None
2026-03-25 22:48:10 [ayvens.be] INFO: Scrape type for 1982387: 1
2026-03-25 22:48:10 [ayvens.be] INFO: Extracting data for car ID: 1982387
2026-03-25 22:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-25 22:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178d2ce4-1420-5197-883e-8acc5a2fadcf with scrape type 1
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/1.jpg not downloaded yet
2026-03-25 22:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-25 22:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384
2026-03-25 22:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2648bf2-7702-5d3b-9ea0-2ef3b30177ae with identifier: 1982384 to the API
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2648bf2-7702-5d3b-9ea0-2ef3b30177ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 138844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2648bf2-7702-5d3b-9ea0-2ef3b30177ae/d2648bf2-7702-5d3b-9ea0-2ef3b30177ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/6e164d4fbad8487984552fd691cb0d68/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982384%27 HTTP/1.1" 200 None
2026-03-25 22:48:10 [ayvens.be] INFO: Saving data for 1982384: {'created_time': 1774478890.422806, 'last_price_update_time': 1774478890.422816, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982384') HTTP/1.1" 204 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/2.jpg not downloaded yet
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/3.jpg not downloaded yet
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d46d0>
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/9.jpg saved to cache
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f4350>
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/8.jpg saved to cache
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9c50>
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/8.jpg saved to cache
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f4ed0>
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F2c4bc8da449a404e877fba81c144831f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/10.jpg saved to cache
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6b1966c-b078-5117-a3fc-cee0c2070ee8
2026-03-25 22:48:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6b1966c-b078-5117-a3fc-cee0c2070ee8, skipping ID generation
2026-03-25 22:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6b1966c-b078-5117-a3fc-cee0c2070ee8 with scrape type 1
2026-03-25 22:48:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6b1966c-b078-5117-a3fc-cee0c2070ee8 sending to next pipeline
2026-03-25 22:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a6b1966c-b078-5117-a3fc-cee0c2070ee8, identifier: 1982385
2026-03-25 22:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-25 22:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385
2026-03-25 22:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a6b1966c-b078-5117-a3fc-cee0c2070ee8 with identifier: 1982385 to the API
2026-03-25 22:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a6b1966c-b078-5117-a3fc-cee0c2070ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 35992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6b1966c-b078-5117-a3fc-cee0c2070ee8/a6b1966c-b078-5117-a3fc-cee0c2070ee8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/2c4bc8da449a404e877fba81c144831f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2 TURBO 74KW S-S ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 74KW S-S ELEGANCE',
 'vin': None,
 'year': 2023}
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982385%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [ayvens.be] INFO: Saving data for 1982385: {'created_time': 1774478891.17965, 'last_price_update_time': 1774478891.179663, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982385') HTTP/1.1" 204 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/4.jpg not downloaded yet
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/5.jpg not downloaded yet
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/6.jpg not downloaded yet
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/7.jpg not downloaded yet
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/8.jpg not downloaded yet
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/9.jpg not downloaded yet
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/10.jpg not downloaded yet
2026-03-25 22:48:11 [ayvens.be] INFO: Found listing with ID: 1982388
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982388%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [ayvens.be] INFO: Scrape type for 1982388: 1
2026-03-25 22:48:11 [ayvens.be] INFO: Extracting data for car ID: 1982388
2026-03-25 22:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-25 22:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with scrape type 1
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/1.jpg not downloaded yet
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6fbd0>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/5.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9610>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/2.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a397210>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/1.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/2.jpg not downloaded yet
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e8dd0>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/3.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fe8f90>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/3.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289eb090>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/5.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7910>
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F0d01f9739326471aa36ac3c18024c3bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/7.jpg saved to cache
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99079dac-8be6-5408-973e-703de7a75c32
2026-03-25 22:48:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99079dac-8be6-5408-973e-703de7a75c32, skipping ID generation
2026-03-25 22:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99079dac-8be6-5408-973e-703de7a75c32 with scrape type 1
2026-03-25 22:48:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99079dac-8be6-5408-973e-703de7a75c32 sending to next pipeline
2026-03-25 22:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99079dac-8be6-5408-973e-703de7a75c32, identifier: 1982383
2026-03-25 22:48:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28906d10>
2026-03-25 22:48:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F8e0d5dea471e4675b55d074932c696bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/4.jpg saved to cache
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be621ee0-f86b-5a1b-9698-2fb276af75a5
2026-03-25 22:48:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be621ee0-f86b-5a1b-9698-2fb276af75a5, skipping ID generation
2026-03-25 22:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be621ee0-f86b-5a1b-9698-2fb276af75a5 with scrape type 1
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be621ee0-f86b-5a1b-9698-2fb276af75a5 sending to next pipeline
2026-03-25 22:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be621ee0-f86b-5a1b-9698-2fb276af75a5, identifier: 1982380
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/3.jpg not downloaded yet
2026-03-25 22:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-25 22:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383
2026-03-25 22:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99079dac-8be6-5408-973e-703de7a75c32 with identifier: 1982383 to the API
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '99079dac-8be6-5408-973e-703de7a75c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 137644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99079dac-8be6-5408-973e-703de7a75c32/99079dac-8be6-5408-973e-703de7a75c32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/0d01f9739326471aa36ac3c18024c3bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE20D (120KW) AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE20D (120KW) AUTO 4WD',
 'vin': None,
 'year': 2020}
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982383%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [ayvens.be] INFO: Saving data for 1982383: {'created_time': 1774478892.50703, 'last_price_update_time': 1774478892.507041, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982383') HTTP/1.1" 204 0
2026-03-25 22:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-25 22:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380
2026-03-25 22:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be621ee0-f86b-5a1b-9698-2fb276af75a5 with identifier: 1982380 to the API
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'be621ee0-f86b-5a1b-9698-2fb276af75a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'Vivaro',
 'odometer': 164503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be621ee0-f86b-5a1b-9698-2fb276af75a5/be621ee0-f86b-5a1b-9698-2fb276af75a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/8e0d5dea471e4675b55d074932c696bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL Vivaro 2.0 TURBO 90KW EDITION L3H1 3.1T AUTO',
 'transmission': 'automatic',
 'trim': '2.0 TURBO 90KW EDITION L3H1 3.1T AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982380%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [ayvens.be] INFO: Saving data for 1982380: {'created_time': 1774478892.848618, 'last_price_update_time': 1774478892.848627, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982380') HTTP/1.1" 204 0
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/4.jpg not downloaded yet
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/5.jpg not downloaded yet
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/6.jpg not downloaded yet
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/7.jpg not downloaded yet
2026-03-25 22:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/8.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/9.jpg not downloaded yet
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4de50>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/4.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/10.jpg not downloaded yet
2026-03-25 22:48:13 [ayvens.be] INFO: Found listing with ID: 1982389
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982389%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [ayvens.be] INFO: Scrape type for 1982389: 1
2026-03-25 22:48:13 [ayvens.be] INFO: Extracting data for car ID: 1982389
2026-03-25 22:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-25 22:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with scrape type 1
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/1.jpg not downloaded yet
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/2.jpg not downloaded yet
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2ce90>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/8.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881a5d0>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/8.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288246d0>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/9.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901d310>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/7.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236403d0>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/6.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881add0>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/2.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21522050>
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/9.jpg saved to cache
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/3.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/4.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/5.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/6.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/7.jpg not downloaded yet
2026-03-25 22:48:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/8.jpg not downloaded yet
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/9.jpg not downloaded yet
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a61a50>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/3.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6cd50>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/1.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28765d50>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/5.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/10.jpg not downloaded yet
2026-03-25 22:48:14 [ayvens.be] INFO: Found listing with ID: 1982390
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982390%27 HTTP/1.1" 200 None
2026-03-25 22:48:14 [ayvens.be] INFO: Scrape type for 1982390: 1
2026-03-25 22:48:14 [ayvens.be] INFO: Extracting data for car ID: 1982390
2026-03-25 22:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-25 22:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e3e61-ae3d-5000-b57d-5ddcb608b172 with scrape type 1
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/1.jpg not downloaded yet
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236496d0>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/4.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e1390>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F82c13a2cfb7543c6bd631fab1683dfba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/10.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbd22d27-98be-52d3-b256-0d95b317e4be
2026-03-25 22:48:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbd22d27-98be-52d3-b256-0d95b317e4be, skipping ID generation
2026-03-25 22:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd22d27-98be-52d3-b256-0d95b317e4be with scrape type 1
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbd22d27-98be-52d3-b256-0d95b317e4be sending to next pipeline
2026-03-25 22:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bbd22d27-98be-52d3-b256-0d95b317e4be, identifier: 1982386
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68490>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/2.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f7590>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0067072bf1c4497a9a54ecbee1600fcc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/1.jpg saved to cache
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8
2026-03-25 22:48:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e96f372-8e58-58b7-9fd7-8293a6199bf8, skipping ID generation
2026-03-25 22:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with scrape type 1
2026-03-25 22:48:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e96f372-8e58-58b7-9fd7-8293a6199bf8 sending to next pipeline
2026-03-25 22:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e96f372-8e58-58b7-9fd7-8293a6199bf8, identifier: 1982189
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fdf50>
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/10.jpg saved to cache
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-25 22:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386
2026-03-25 22:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bbd22d27-98be-52d3-b256-0d95b317e4be with identifier: 1982386 to the API
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bbd22d27-98be-52d3-b256-0d95b317e4be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 921817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbd22d27-98be-52d3-b256-0d95b317e4be/bbd22d27-98be-52d3-b256-0d95b317e4be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/82c13a2cfb7543c6bd631fab1683dfba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982386%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [ayvens.be] INFO: Saving data for 1982386: {'created_time': 1774478895.36424, 'last_price_update_time': 1774478895.364251, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982386') HTTP/1.1" 204 0
2026-03-25 22:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with identifier: 1982189
2026-03-25 22:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with identifier: 1982189
2026-03-25 22:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e96f372-8e58-58b7-9fd7-8293a6199bf8 with identifier: 1982189 to the API
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '9e96f372-8e58-58b7-9fd7-8293a6199bf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 28582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e96f372-8e58-58b7-9fd7-8293a6199bf8/9e96f372-8e58-58b7-9fd7-8293a6199bf8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0067072bf1c4497a9a54ecbee1600fcc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982189%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [ayvens.be] INFO: Saving data for 1982189: {'created_time': 1774478895.668102, 'last_price_update_time': 1774478895.668115, 'auction_closing_time': 1775037600.0}
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982189') HTTP/1.1" 204 0
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/2.jpg not downloaded yet
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/3.jpg not downloaded yet
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/4.jpg not downloaded yet
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/5.jpg not downloaded yet
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/6.jpg not downloaded yet
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/7.jpg not downloaded yet
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/8.jpg not downloaded yet
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7c710>
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/5.jpg saved to cache
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/9.jpg not downloaded yet
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7de50>
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/3.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/10.jpg not downloaded yet
2026-03-25 22:48:16 [ayvens.be] INFO: Found listing with ID: 1982391
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982391%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [ayvens.be] INFO: Scrape type for 1982391: 1
2026-03-25 22:48:16 [ayvens.be] INFO: Extracting data for car ID: 1982391
2026-03-25 22:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-25 22:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d0d71e-61e4-53aa-8104-89fd0eb13100 with scrape type 1
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/1.jpg not downloaded yet
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288acfd0>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/4.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a5550>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/3.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eddd0>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/1.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7dc10>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/2.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22150>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/10.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28831110>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/9.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/2.jpg not downloaded yet
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/3.jpg not downloaded yet
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/4.jpg not downloaded yet
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/5.jpg not downloaded yet
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/6.jpg not downloaded yet
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/7.jpg not downloaded yet
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/8.jpg not downloaded yet
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/9.jpg not downloaded yet
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0e650>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/7.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e33d0>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/2.jpg saved to cache
2026-03-25 22:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7fd90>
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/8.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0c610>
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/6.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/10.jpg not downloaded yet
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288be890>
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/4.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fe790>
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/5.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a605d0>
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/6.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99d90>
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aw%252F30453783ab184c74947c36b95d5e08af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/1.jpg saved to cache
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a
2026-03-25 22:48:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a, skipping ID generation
2026-03-25 22:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with scrape type 1
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4b137ce-0d50-5531-b5f8-17b4e65f0c5a sending to next pipeline
2026-03-25 22:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a, identifier: 1982388
2026-03-25 22:48:17 [ayvens.be] INFO: Found listing with ID: 1982392
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982392%27 HTTP/1.1" 200 None
2026-03-25 22:48:17 [ayvens.be] INFO: Scrape type for 1982392: 1
2026-03-25 22:48:17 [ayvens.be] INFO: Extracting data for car ID: 1982392
2026-03-25 22:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-25 22:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efed24f-a385-57ca-9506-c473184ac7b2 with scrape type 1
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/1.jpg not downloaded yet
2026-03-25 22:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-25 22:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388
2026-03-25 22:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4b137ce-0d50-5531-b5f8-17b4e65f0c5a with identifier: 1982388 to the API
2026-03-25 22:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c4b137ce-0d50-5531-b5f8-17b4e65f0c5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 147755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4b137ce-0d50-5531-b5f8-17b4e65f0c5a/c4b137ce-0d50-5531-b5f8-17b4e65f0c5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aw/30453783ab184c74947c36b95d5e08af/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 200 D DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982388%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [ayvens.be] INFO: Saving data for 1982388: {'created_time': 1774478898.148764, 'last_price_update_time': 1774478898.148774, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982388') HTTP/1.1" 204 0
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/2.jpg not downloaded yet
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368a350>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/2.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/3.jpg not downloaded yet
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/4.jpg not downloaded yet
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21517650>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/1.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23600d50>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/9.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/5.jpg not downloaded yet
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/6.jpg not downloaded yet
2026-03-25 22:48:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/7.jpg not downloaded yet
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503750>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/10.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a969d0>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/9.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2152ae50>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/3.jpg saved to cache
2026-03-25 22:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a95b90>
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/8.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/8.jpg not downloaded yet
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/9.jpg not downloaded yet
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881be90>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/8.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749750>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/2.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/10.jpg not downloaded yet
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [ayvens.be] INFO: Found listing with ID: 1982393
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982393%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [ayvens.be] INFO: Scrape type for 1982393: 1
2026-03-25 22:48:19 [ayvens.be] INFO: Extracting data for car ID: 1982393
2026-03-25 22:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-25 22:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13cdafa-b2ee-57a4-88ef-f2d298604d46 with scrape type 1
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/1.jpg not downloaded yet
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/2.jpg not downloaded yet
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741a50>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/10.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/3.jpg not downloaded yet
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/4.jpg not downloaded yet
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28936910>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/7.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287dbf10>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/1.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d34d50>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/9.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28774350>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/10.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d36310>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/7.jpg saved to cache
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/5.jpg not downloaded yet
2026-03-25 22:48:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/6.jpg not downloaded yet
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/7.jpg not downloaded yet
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514810>
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/8.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/8.jpg not downloaded yet
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/9.jpg not downloaded yet
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad210>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/6.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/10.jpg not downloaded yet
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [ayvens.be] INFO: Found listing with ID: 1982394
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982394%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [ayvens.be] INFO: Scrape type for 1982394: 1
2026-03-25 22:48:20 [ayvens.be] INFO: Extracting data for car ID: 1982394
2026-03-25 22:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-25 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c7018-685a-5c56-aef3-34cef35012df with scrape type 1
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/1.jpg not downloaded yet
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/2.jpg not downloaded yet
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876d290>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/2.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc6f90>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/5.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28830c90>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/1.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc4d50>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/3.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/3.jpg not downloaded yet
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/4.jpg not downloaded yet
2026-03-25 22:48:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa7350>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/3.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515a90>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/4.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236484d0>
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1vr%252F49ad7c224140475cb165e5e3b7587d87%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/4.jpg saved to cache
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80d0d71e-61e4-53aa-8104-89fd0eb13100
2026-03-25 22:48:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80d0d71e-61e4-53aa-8104-89fd0eb13100, skipping ID generation
2026-03-25 22:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d0d71e-61e4-53aa-8104-89fd0eb13100 with scrape type 1
2026-03-25 22:48:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80d0d71e-61e4-53aa-8104-89fd0eb13100 sending to next pipeline
2026-03-25 22:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80d0d71e-61e4-53aa-8104-89fd0eb13100, identifier: 1982391
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/5.jpg not downloaded yet
2026-03-25 22:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-25 22:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391
2026-03-25 22:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80d0d71e-61e4-53aa-8104-89fd0eb13100 with identifier: 1982391 to the API
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '80d0d71e-61e4-53aa-8104-89fd0eb13100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Touran',
 'odometer': 128349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0d71e-61e4-53aa-8104-89fd0eb13100/80d0d71e-61e4-53aa-8104-89fd0eb13100_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1vr/49ad7c224140475cb165e5e3b7587d87/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Touran 1.0 TSI Highline OPF (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI Highline OPF (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982391%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [ayvens.be] INFO: Saving data for 1982391: {'created_time': 1774478901.364453, 'last_price_update_time': 1774478901.364465, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982391') HTTP/1.1" 204 0
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/6.jpg not downloaded yet
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/7.jpg not downloaded yet
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361fd50>
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/6.jpg saved to cache
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361fd50>
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/9.jpg saved to cache
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877ebd0>
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/8.jpg saved to cache
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/8.jpg not downloaded yet
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/9.jpg not downloaded yet
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742bd0>
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/5.jpg saved to cache
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c98d0>
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/10.jpg saved to cache
2026-03-25 22:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/10.jpg not downloaded yet
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [ayvens.be] INFO: Found listing with ID: 1982395
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982395%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [ayvens.be] INFO: Scrape type for 1982395: 1
2026-03-25 22:48:22 [ayvens.be] INFO: Extracting data for car ID: 1982395
2026-03-25 22:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-25 22:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27dd3695-4e0b-5809-85a4-687e95d181bb with scrape type 1
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/1.jpg not downloaded yet
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/2.jpg not downloaded yet
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668550>
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/1.jpg saved to cache
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f3390>
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe4ca9fb97ce947c4a7f7c80f8543b0f2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/7.jpg saved to cache
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4efed24f-a385-57ca-9506-c473184ac7b2
2026-03-25 22:48:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4efed24f-a385-57ca-9506-c473184ac7b2, skipping ID generation
2026-03-25 22:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efed24f-a385-57ca-9506-c473184ac7b2 with scrape type 1
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4efed24f-a385-57ca-9506-c473184ac7b2 sending to next pipeline
2026-03-25 22:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4efed24f-a385-57ca-9506-c473184ac7b2, identifier: 1982392
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515850>
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/2.jpg saved to cache
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-25 22:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392
2026-03-25 22:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4efed24f-a385-57ca-9506-c473184ac7b2 with identifier: 1982392 to the API
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4efed24f-a385-57ca-9506-c473184ac7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN - 2016',
 'odometer': 122796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4efed24f-a385-57ca-9506-c473184ac7b2/4efed24f-a385-57ca-9506-c473184ac7b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e4ca9fb97ce947c4a7f7c80f8543b0f2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN - 2016 1.5 TSI ACT IQ.Drive OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT IQ.Drive OPF DSG',
 'vin': None,
 'year': 2020}
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982392%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [ayvens.be] INFO: Saving data for 1982392: {'created_time': 1774478902.760937, 'last_price_update_time': 1774478902.760946, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982392') HTTP/1.1" 204 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/3.jpg not downloaded yet
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/4.jpg not downloaded yet
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d9790>
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/5.jpg saved to cache
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879a790>
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/7.jpg saved to cache
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/5.jpg not downloaded yet
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/6.jpg not downloaded yet
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21529190>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/6.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2367fa50>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/8.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/7.jpg not downloaded yet
2026-03-25 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/8.jpg not downloaded yet
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366a510>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/4.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99f10>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/3.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0990>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/10.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/9.jpg not downloaded yet
2026-03-25 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/10.jpg not downloaded yet
2026-03-25 22:48:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:23 [ayvens.be] INFO: Found listing with ID: 1982396
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982396%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [ayvens.be] INFO: Scrape type for 1982396: 1
2026-03-25 22:48:23 [ayvens.be] INFO: Extracting data for car ID: 1982396
2026-03-25 22:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-25 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04e2942-b8f6-5cff-9240-2024048ae747 with scrape type 1
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/1.jpg not downloaded yet
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288adfd0>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/2.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f75d0>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/3.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e2110>
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wv%252F64c97ce420d8484385ced385cf1affa7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/9.jpg saved to cache
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c13cdafa-b2ee-57a4-88ef-f2d298604d46
2026-03-25 22:48:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c13cdafa-b2ee-57a4-88ef-f2d298604d46, skipping ID generation
2026-03-25 22:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13cdafa-b2ee-57a4-88ef-f2d298604d46 with scrape type 1
2026-03-25 22:48:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c13cdafa-b2ee-57a4-88ef-f2d298604d46 sending to next pipeline
2026-03-25 22:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c13cdafa-b2ee-57a4-88ef-f2d298604d46, identifier: 1982393
2026-03-25 22:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-25 22:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393
2026-03-25 22:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c13cdafa-b2ee-57a4-88ef-f2d298604d46 with identifier: 1982393 to the API
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c13cdafa-b2ee-57a4-88ef-f2d298604d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA COMBI - 2018',
 'odometer': 131540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 901377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 827695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c13cdafa-b2ee-57a4-88ef-f2d298604d46/c13cdafa-b2ee-57a4-88ef-f2d298604d46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wv/64c97ce420d8484385ced385cf1affa7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA COMBI - 2018 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982393%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [ayvens.be] INFO: Saving data for 1982393: {'created_time': 1774478904.281637, 'last_price_update_time': 1774478904.281646, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982393') HTTP/1.1" 204 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/2.jpg not downloaded yet
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/3.jpg not downloaded yet
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368bf90>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/4.jpg saved to cache
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28832110>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/5.jpg saved to cache
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/4.jpg not downloaded yet
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/5.jpg not downloaded yet
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21510c10>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/1.jpg saved to cache
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215103d0>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/6.jpg saved to cache
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/6.jpg not downloaded yet
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/7.jpg not downloaded yet
2026-03-25 22:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b98ad0>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/6.jpg saved to cache
2026-03-25 22:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9290>
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/7.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/8.jpg not downloaded yet
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/9.jpg not downloaded yet
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/10.jpg not downloaded yet
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28832110>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/8.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876ee90>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/9.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874b550>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/2.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876f010>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/3.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [ayvens.be] INFO: Found listing with ID: 1982397
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982397%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [ayvens.be] INFO: Scrape type for 1982397: 1
2026-03-25 22:48:25 [ayvens.be] INFO: Extracting data for car ID: 1982397
2026-03-25 22:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-25 22:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with scrape type 1
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/1.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/2.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/3.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/4.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/5.jpg not downloaded yet
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924450>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/5.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/6.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/7.jpg not downloaded yet
2026-03-25 22:48:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/8.jpg not downloaded yet
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b5050>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/4.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6fd50>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/5.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28748890>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/1.jpg saved to cache
2026-03-25 22:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c11d0>
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/6.jpg saved to cache
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/9.jpg not downloaded yet
2026-03-25 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/10.jpg not downloaded yet
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e2c90>
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F23052930b12f48a1a39b9308033be080%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/10.jpg saved to cache
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 328c7018-685a-5c56-aef3-34cef35012df
2026-03-25 22:48:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 328c7018-685a-5c56-aef3-34cef35012df, skipping ID generation
2026-03-25 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328c7018-685a-5c56-aef3-34cef35012df with scrape type 1
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 328c7018-685a-5c56-aef3-34cef35012df sending to next pipeline
2026-03-25 22:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328c7018-685a-5c56-aef3-34cef35012df, identifier: 1982394
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ae690>
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/8.jpg saved to cache
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ba8110>
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/10.jpg saved to cache
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0e2d0>
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/1.jpg saved to cache
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:26 [ayvens.be] INFO: Found listing with ID: 1982398
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982398%27 HTTP/1.1" 200 None
2026-03-25 22:48:26 [ayvens.be] INFO: Scrape type for 1982398: 1
2026-03-25 22:48:26 [ayvens.be] INFO: Extracting data for car ID: 1982398
2026-03-25 22:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-25 22:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c333d1-b709-5396-9cd4-5959711c6956 with scrape type 1
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/1.jpg not downloaded yet
2026-03-25 22:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-25 22:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394
2026-03-25 22:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328c7018-685a-5c56-aef3-34cef35012df with identifier: 1982394 to the API
2026-03-25 22:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '328c7018-685a-5c56-aef3-34cef35012df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 123308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 888728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328c7018-685a-5c56-aef3-34cef35012df/328c7018-685a-5c56-aef3-34cef35012df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/23052930b12f48a1a39b9308033be080/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982394%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [ayvens.be] INFO: Saving data for 1982394: {'created_time': 1774478907.105256, 'last_price_update_time': 1774478907.105265, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982394') HTTP/1.1" 204 0
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/2.jpg not downloaded yet
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/3.jpg not downloaded yet
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e8710>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/2.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364ba10>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/5.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/4.jpg not downloaded yet
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/5.jpg not downloaded yet
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688910>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/6.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7ae50>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/3.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c0a50>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/9.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/6.jpg not downloaded yet
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/7.jpg not downloaded yet
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/8.jpg not downloaded yet
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b788d0>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/7.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215101d0>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/4.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0ee90>
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Fe8b9ff0473c14573a32a3fe008383423%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/9.jpg saved to cache
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27dd3695-4e0b-5809-85a4-687e95d181bb
2026-03-25 22:48:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27dd3695-4e0b-5809-85a4-687e95d181bb, skipping ID generation
2026-03-25 22:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27dd3695-4e0b-5809-85a4-687e95d181bb with scrape type 1
2026-03-25 22:48:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27dd3695-4e0b-5809-85a4-687e95d181bb sending to next pipeline
2026-03-25 22:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27dd3695-4e0b-5809-85a4-687e95d181bb, identifier: 1982395
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb6c50>
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/10.jpg saved to cache
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-25 22:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395
2026-03-25 22:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27dd3695-4e0b-5809-85a4-687e95d181bb with identifier: 1982395 to the API
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '27dd3695-4e0b-5809-85a4-687e95d181bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 147027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 792938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27dd3695-4e0b-5809-85a4-687e95d181bb/27dd3695-4e0b-5809-85a4-687e95d181bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/e8b9ff0473c14573a32a3fe008383423/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 330E (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 330E (135KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982395%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [ayvens.be] INFO: Saving data for 1982395: {'created_time': 1774478908.503659, 'last_price_update_time': 1774478908.503668, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982395') HTTP/1.1" 204 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/9.jpg not downloaded yet
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/10.jpg not downloaded yet
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a60210>
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/2.jpg saved to cache
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7150>
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/3.jpg saved to cache
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [ayvens.be] INFO: Found listing with ID: 1982399
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982399%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [ayvens.be] INFO: Scrape type for 1982399: 1
2026-03-25 22:48:28 [ayvens.be] INFO: Extracting data for car ID: 1982399
2026-03-25 22:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-25 22:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2132b37f-1729-5a11-9802-554987bbc326 with scrape type 1
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/1.jpg not downloaded yet
2026-03-25 22:48:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/2.jpg not downloaded yet
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cb290>
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/1.jpg saved to cache
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215220d0>
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/4.jpg saved to cache
2026-03-25 22:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/3.jpg not downloaded yet
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/4.jpg not downloaded yet
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28792bd0>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/8.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1e50>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/7.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b98d90>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/5.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1610>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/6.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/5.jpg not downloaded yet
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/6.jpg not downloaded yet
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/7.jpg not downloaded yet
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21502750>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/10.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874a990>
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cj%252F51922d62eb35401b81faca0ca1042301%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/9.jpg saved to cache
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284
2026-03-25 22:48:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45f31c3c-3d1f-5c7e-a872-731aafd2b284, skipping ID generation
2026-03-25 22:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with scrape type 1
2026-03-25 22:48:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45f31c3c-3d1f-5c7e-a872-731aafd2b284 sending to next pipeline
2026-03-25 22:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45f31c3c-3d1f-5c7e-a872-731aafd2b284, identifier: 1982397
2026-03-25 22:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-25 22:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397
2026-03-25 22:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45f31c3c-3d1f-5c7e-a872-731aafd2b284 with identifier: 1982397 to the API
2026-03-25 22:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '45f31c3c-3d1f-5c7e-a872-731aafd2b284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 39475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f31c3c-3d1f-5c7e-a872-731aafd2b284/45f31c3c-3d1f-5c7e-a872-731aafd2b284_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cj/51922d62eb35401b81faca0ca1042301/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982397%27 HTTP/1.1" 200 None
2026-03-25 22:48:30 [ayvens.be] INFO: Saving data for 1982397: {'created_time': 1774478910.222854, 'last_price_update_time': 1774478910.222864, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982397') HTTP/1.1" 204 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/8.jpg not downloaded yet
2026-03-25 22:48:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/9.jpg not downloaded yet
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28916e50>
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/8.jpg saved to cache
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1c9d0>
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F8f578edd480c421486488e65866388ae%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/7.jpg saved to cache
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b04e2942-b8f6-5cff-9240-2024048ae747
2026-03-25 22:48:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b04e2942-b8f6-5cff-9240-2024048ae747, skipping ID generation
2026-03-25 22:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04e2942-b8f6-5cff-9240-2024048ae747 with scrape type 1
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b04e2942-b8f6-5cff-9240-2024048ae747 sending to next pipeline
2026-03-25 22:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b04e2942-b8f6-5cff-9240-2024048ae747, identifier: 1982396
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901d890>
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/1.jpg saved to cache
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28756890>
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/2.jpg saved to cache
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f750>
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/3.jpg saved to cache
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/10.jpg not downloaded yet
2026-03-25 22:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-25 22:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396
2026-03-25 22:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b04e2942-b8f6-5cff-9240-2024048ae747 with identifier: 1982396 to the API
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b04e2942-b8f6-5cff-9240-2024048ae747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 56538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04e2942-b8f6-5cff-9240-2024048ae747/b04e2942-b8f6-5cff-9240-2024048ae747_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/8f578edd480c421486488e65866388ae/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982396%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [ayvens.be] INFO: Saving data for 1982396: {'created_time': 1774478911.338866, 'last_price_update_time': 1774478911.338876, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982396') HTTP/1.1" 204 0
2026-03-25 22:48:31 [ayvens.be] INFO: Found listing with ID: 1982400
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982400%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [ayvens.be] INFO: Scrape type for 1982400: 1
2026-03-25 22:48:31 [ayvens.be] INFO: Extracting data for car ID: 1982400
2026-03-25 22:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-25 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599545e4-b508-5eeb-80b3-1961aaf1d328 with scrape type 1
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/1.jpg not downloaded yet
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880bbd0>
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F6da37a66670b43e5b857c256280ab033%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/4.jpg saved to cache
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b34e3e61-ae3d-5000-b57d-5ddcb608b172
2026-03-25 22:48:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b34e3e61-ae3d-5000-b57d-5ddcb608b172, skipping ID generation
2026-03-25 22:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b34e3e61-ae3d-5000-b57d-5ddcb608b172 with scrape type 1
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b34e3e61-ae3d-5000-b57d-5ddcb608b172 sending to next pipeline
2026-03-25 22:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b34e3e61-ae3d-5000-b57d-5ddcb608b172, identifier: 1982390
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-25 22:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390
2026-03-25 22:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b34e3e61-ae3d-5000-b57d-5ddcb608b172 with identifier: 1982390 to the API
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b34e3e61-ae3d-5000-b57d-5ddcb608b172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 121404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b34e3e61-ae3d-5000-b57d-5ddcb608b172/b34e3e61-ae3d-5000-b57d-5ddcb608b172_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/6da37a66670b43e5b857c256280ab033/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982390%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [ayvens.be] INFO: Saving data for 1982390: {'created_time': 1774478911.904237, 'last_price_update_time': 1774478911.904256, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982390') HTTP/1.1" 204 0
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/2.jpg not downloaded yet
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/3.jpg not downloaded yet
2026-03-25 22:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a355350>
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/6.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917890>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/9.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/4.jpg not downloaded yet
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/5.jpg not downloaded yet
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23647e50>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/10.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28819510>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/7.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e2110>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/5.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881a210>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/8.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/6.jpg not downloaded yet
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/7.jpg not downloaded yet
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/8.jpg not downloaded yet
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/9.jpg not downloaded yet
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/10.jpg not downloaded yet
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [ayvens.be] INFO: Found listing with ID: 1982401
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982401%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [ayvens.be] INFO: Scrape type for 1982401: 1
2026-03-25 22:48:32 [ayvens.be] INFO: Extracting data for car ID: 1982401
2026-03-25 22:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-25 22:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16cc5be1-f268-5e3b-abb9-442e4406b2da with scrape type 1
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/1.jpg not downloaded yet
2026-03-25 22:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ba5d0>
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252Ffc0594bdec2b4aebb7c1c854b4b1a2fc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/4.jpg saved to cache
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53c333d1-b709-5396-9cd4-5959711c6956
2026-03-25 22:48:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53c333d1-b709-5396-9cd4-5959711c6956, skipping ID generation
2026-03-25 22:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c333d1-b709-5396-9cd4-5959711c6956 with scrape type 1
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53c333d1-b709-5396-9cd4-5959711c6956 sending to next pipeline
2026-03-25 22:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53c333d1-b709-5396-9cd4-5959711c6956, identifier: 1982398
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/2.jpg not downloaded yet
2026-03-25 22:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-25 22:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398
2026-03-25 22:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53c333d1-b709-5396-9cd4-5959711c6956 with identifier: 1982398 to the API
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '53c333d1-b709-5396-9cd4-5959711c6956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK - 2020',
 'odometer': 57899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c333d1-b709-5396-9cd4-5959711c6956/53c333d1-b709-5396-9cd4-5959711c6956_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/fc0594bdec2b4aebb7c1c854b4b1a2fc/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK - 2020 35 TFSI Advanced',
 'transmission': 'manual',
 'trim': '35 TFSI Advanced',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982398%27 HTTP/1.1" 200 None
2026-03-25 22:48:33 [ayvens.be] INFO: Saving data for 1982398: {'created_time': 1774478913.283197, 'last_price_update_time': 1774478913.283207, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982398') HTTP/1.1" 204 0
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fab10>
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/1.jpg saved to cache
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/3.jpg not downloaded yet
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23649210>
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/2.jpg saved to cache
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eda10>
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/5.jpg saved to cache
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f9c50>
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/3.jpg saved to cache
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9ab50>
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F50cd484cf593403097cd39767d058f0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/7.jpg saved to cache
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2
2026-03-25 22:48:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2, skipping ID generation
2026-03-25 22:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with scrape type 1
2026-03-25 22:48:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 sending to next pipeline
2026-03-25 22:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2, identifier: 1982389
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362efd0>
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/4.jpg saved to cache
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876e050>
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/6.jpg saved to cache
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/4.jpg not downloaded yet
2026-03-25 22:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-25 22:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389
2026-03-25 22:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2 with identifier: 1982389 to the API
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 128409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2/1cd6e8e0-33bb-5180-b480-aaafa6ba2fa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/50cd484cf593403097cd39767d058f0c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 200 D BUSINESS SOLUTION LIM DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION LIM DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982389%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [ayvens.be] INFO: Saving data for 1982389: {'created_time': 1774478914.576671, 'last_price_update_time': 1774478914.57668, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982389') HTTP/1.1" 204 0
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/5.jpg not downloaded yet
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/6.jpg not downloaded yet
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/7.jpg not downloaded yet
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/8.jpg not downloaded yet
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/9.jpg not downloaded yet
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/10.jpg not downloaded yet
2026-03-25 22:48:34 [ayvens.be] INFO: Found listing with ID: 1982402
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982402%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [ayvens.be] INFO: Scrape type for 1982402: 1
2026-03-25 22:48:34 [ayvens.be] INFO: Extracting data for car ID: 1982402
2026-03-25 22:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-25 22:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with scrape type 1
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/1.jpg not downloaded yet
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/2.jpg not downloaded yet
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28927210>
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/7.jpg saved to cache
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368aed0>
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/1.jpg saved to cache
2026-03-25 22:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28754450>
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/2.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749a90>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/8.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/3.jpg not downloaded yet
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ca950>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/9.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21514fd0>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cg%252Fbee5d87a6c134214ad2c31c35f240fcd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/10.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2132b37f-1729-5a11-9802-554987bbc326
2026-03-25 22:48:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2132b37f-1729-5a11-9802-554987bbc326, skipping ID generation
2026-03-25 22:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2132b37f-1729-5a11-9802-554987bbc326 with scrape type 1
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2132b37f-1729-5a11-9802-554987bbc326 sending to next pipeline
2026-03-25 22:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2132b37f-1729-5a11-9802-554987bbc326, identifier: 1982399
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a722f50>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/9.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9590>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/10.jpg saved to cache
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/4.jpg not downloaded yet
2026-03-25 22:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-25 22:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399
2026-03-25 22:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2132b37f-1729-5a11-9802-554987bbc326 with identifier: 1982399 to the API
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2132b37f-1729-5a11-9802-554987bbc326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 82590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 872089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2132b37f-1729-5a11-9802-554987bbc326/2132b37f-1729-5a11-9802-554987bbc326_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cg/bee5d87a6c134214ad2c31c35f240fcd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.0 ETSI 110 MOVE! DSG',
 'transmission': 'automatic',
 'trim': '1.0 ETSI 110 MOVE! DSG',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982399%27 HTTP/1.1" 200 None
2026-03-25 22:48:35 [ayvens.be] INFO: Saving data for 1982399: {'created_time': 1774478915.951199, 'last_price_update_time': 1774478915.951209, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982399') HTTP/1.1" 204 0
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/5.jpg not downloaded yet
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28767250>
2026-03-25 22:48:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/5.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150af50>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/3.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/6.jpg not downloaded yet
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627ad0>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/4.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2ee50>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/6.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e1950>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/1.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ffa50>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/2.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/7.jpg not downloaded yet
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/8.jpg not downloaded yet
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926510>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/7.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b49b50>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/8.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/9.jpg not downloaded yet
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/10.jpg not downloaded yet
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23655bd0>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/5.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0ced0>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/4.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0ee10>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/10.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288094d0>
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/6.jpg saved to cache
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:36 [ayvens.be] INFO: Found listing with ID: 1982403
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982403%27 HTTP/1.1" 200 None
2026-03-25 22:48:36 [ayvens.be] INFO: Scrape type for 1982403: 1
2026-03-25 22:48:36 [ayvens.be] INFO: Extracting data for car ID: 1982403
2026-03-25 22:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-25 22:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84095232-8b51-51e3-a551-1ababe15656e with scrape type 1
2026-03-25 22:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/1.jpg not downloaded yet
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/2.jpg not downloaded yet
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/3.jpg not downloaded yet
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/4.jpg not downloaded yet
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21509750>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/2.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288311d0>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/9.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7f50>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/10.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/5.jpg not downloaded yet
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/6.jpg not downloaded yet
2026-03-25 22:48:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/7.jpg not downloaded yet
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28937950>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/4.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee450>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/3.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876e1d0>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/8.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28748ed0>
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252Fd5697581922841458d5f4b96cae3da27%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/7.jpg saved to cache
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16cc5be1-f268-5e3b-abb9-442e4406b2da
2026-03-25 22:48:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16cc5be1-f268-5e3b-abb9-442e4406b2da, skipping ID generation
2026-03-25 22:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16cc5be1-f268-5e3b-abb9-442e4406b2da with scrape type 1
2026-03-25 22:48:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16cc5be1-f268-5e3b-abb9-442e4406b2da sending to next pipeline
2026-03-25 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16cc5be1-f268-5e3b-abb9-442e4406b2da, identifier: 1982401
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236476d0>
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/1.jpg saved to cache
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-25 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401
2026-03-25 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16cc5be1-f268-5e3b-abb9-442e4406b2da with identifier: 1982401 to the API
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '16cc5be1-f268-5e3b-abb9-442e4406b2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 47504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16cc5be1-f268-5e3b-abb9-442e4406b2da/16cc5be1-f268-5e3b-abb9-442e4406b2da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/d5697581922841458d5f4b96cae3da27/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982401%27 HTTP/1.1" 200 None
2026-03-25 22:48:38 [ayvens.be] INFO: Saving data for 1982401: {'created_time': 1774478918.505059, 'last_price_update_time': 1774478918.505069, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982401') HTTP/1.1" 204 0
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/8.jpg not downloaded yet
2026-03-25 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/9.jpg not downloaded yet
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b7310>
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/9.jpg saved to cache
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368bf90>
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252F79c9b8169d004c1a920161adb13e55a2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/3.jpg saved to cache
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 599545e4-b508-5eeb-80b3-1961aaf1d328
2026-03-25 22:48:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 599545e4-b508-5eeb-80b3-1961aaf1d328, skipping ID generation
2026-03-25 22:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599545e4-b508-5eeb-80b3-1961aaf1d328 with scrape type 1
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 599545e4-b508-5eeb-80b3-1961aaf1d328 sending to next pipeline
2026-03-25 22:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 599545e4-b508-5eeb-80b3-1961aaf1d328, identifier: 1982400
2026-03-25 22:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/10.jpg not downloaded yet
2026-03-25 22:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-25 22:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400
2026-03-25 22:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 599545e4-b508-5eeb-80b3-1961aaf1d328 with identifier: 1982400 to the API
2026-03-25 22:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '599545e4-b508-5eeb-80b3-1961aaf1d328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 48354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599545e4-b508-5eeb-80b3-1961aaf1d328/599545e4-b508-5eeb-80b3-1961aaf1d328_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/79c9b8169d004c1a920161adb13e55a2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982400%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [ayvens.be] INFO: Saving data for 1982400: {'created_time': 1774478919.167415, 'last_price_update_time': 1774478919.167424, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982400') HTTP/1.1" 204 0
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [ayvens.be] INFO: Found listing with ID: 1982404
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982404%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [ayvens.be] INFO: Scrape type for 1982404: 1
2026-03-25 22:48:39 [ayvens.be] INFO: Extracting data for car ID: 1982404
2026-03-25 22:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-25 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with scrape type 1
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/1.jpg not downloaded yet
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28743b50>
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/5.jpg saved to cache
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/2.jpg not downloaded yet
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a6499d0>
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/7.jpg saved to cache
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/3.jpg not downloaded yet
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22d50>
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/8.jpg saved to cache
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28776650>
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/6.jpg saved to cache
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892dcd0>
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fb2f3f9f5645642f6a4cc50eaddc65349%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/6.jpg saved to cache
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 178d2ce4-1420-5197-883e-8acc5a2fadcf
2026-03-25 22:48:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 178d2ce4-1420-5197-883e-8acc5a2fadcf, skipping ID generation
2026-03-25 22:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178d2ce4-1420-5197-883e-8acc5a2fadcf with scrape type 1
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 178d2ce4-1420-5197-883e-8acc5a2fadcf sending to next pipeline
2026-03-25 22:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 178d2ce4-1420-5197-883e-8acc5a2fadcf, identifier: 1982387
2026-03-25 22:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/4.jpg not downloaded yet
2026-03-25 22:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-25 22:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387
2026-03-25 22:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 178d2ce4-1420-5197-883e-8acc5a2fadcf with identifier: 1982387 to the API
2026-03-25 22:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '178d2ce4-1420-5197-883e-8acc5a2fadcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 67305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178d2ce4-1420-5197-883e-8acc5a2fadcf/178d2ce4-1420-5197-883e-8acc5a2fadcf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/b2f3f9f5645642f6a4cc50eaddc65349/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 EVOLUTION',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 EVOLUTION',
 'vin': None,
 'year': 2023}
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982387%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [ayvens.be] INFO: Saving data for 1982387: {'created_time': 1774478920.122697, 'last_price_update_time': 1774478920.122706, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982387') HTTP/1.1" 204 0
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/5.jpg not downloaded yet
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236270d0>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/10.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cb150>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/7.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236547d0>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/9.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/6.jpg not downloaded yet
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7ebd0>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/1.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/7.jpg not downloaded yet
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881cfd0>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/2.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/8.jpg not downloaded yet
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/9.jpg not downloaded yet
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901f190>
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F13dcbbfe46524149af874d2961281791%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/8.jpg saved to cache
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1
2026-03-25 22:48:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1, skipping ID generation
2026-03-25 22:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with scrape type 1
2026-03-25 22:48:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 sending to next pipeline
2026-03-25 22:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1, identifier: 1982402
2026-03-25 22:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-25 22:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402
2026-03-25 22:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1 with identifier: 1982402 to the API
2026-03-25 22:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 77696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1/9d4aadd3-e23a-56f6-8c5a-98ebd740c6d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/13dcbbfe46524149af874d2961281791/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 d sDrive16 AdBlue',
 'transmission': 'manual',
 'trim': '1.5 d sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982402%27 HTTP/1.1" 200 None
2026-03-25 22:48:41 [ayvens.be] INFO: Saving data for 1982402: {'created_time': 1774478921.244205, 'last_price_update_time': 1774478921.244216, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982402') HTTP/1.1" 204 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/10.jpg not downloaded yet
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [ayvens.be] INFO: Found listing with ID: 1982405
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982405%27 HTTP/1.1" 200 None
2026-03-25 22:48:41 [ayvens.be] INFO: Scrape type for 1982405: 1
2026-03-25 22:48:41 [ayvens.be] INFO: Extracting data for car ID: 1982405
2026-03-25 22:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-25 22:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with scrape type 1
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/1.jpg not downloaded yet
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7b510>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/3.jpg saved to cache
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21521f10>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/5.jpg saved to cache
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362d750>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/6.jpg saved to cache
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fb910>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/9.jpg saved to cache
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ede10>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/8.jpg saved to cache
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/2.jpg not downloaded yet
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28935c50>
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/8.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a3600d0>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/9.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/3.jpg not downloaded yet
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/4.jpg not downloaded yet
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/5.jpg not downloaded yet
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a6bf10>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/1.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516950>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/7.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236faf90>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/4.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21517510>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/3.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876e1d0>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/2.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/6.jpg not downloaded yet
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/7.jpg not downloaded yet
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc6ad0>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F686c0d8ef63a42c0a6008a85d74bf66c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/10.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84095232-8b51-51e3-a551-1ababe15656e
2026-03-25 22:48:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84095232-8b51-51e3-a551-1ababe15656e, skipping ID generation
2026-03-25 22:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84095232-8b51-51e3-a551-1ababe15656e with scrape type 1
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84095232-8b51-51e3-a551-1ababe15656e sending to next pipeline
2026-03-25 22:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84095232-8b51-51e3-a551-1ababe15656e, identifier: 1982403
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fa190>
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/4.jpg saved to cache
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/8.jpg not downloaded yet
2026-03-25 22:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-25 22:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403
2026-03-25 22:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84095232-8b51-51e3-a551-1ababe15656e with identifier: 1982403 to the API
2026-03-25 22:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '84095232-8b51-51e3-a551-1ababe15656e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS BREAK',
 'odometer': 65360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84095232-8b51-51e3-a551-1ababe15656e/84095232-8b51-51e3-a551-1ababe15656e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/686c0d8ef63a42c0a6008a85d74bf66c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS BREAK 2.0 C 300 E PHEV AUTO LUXURY LINE',
 'transmission': 'automatic',
 'trim': '2.0 C 300 E PHEV AUTO LUXURY LINE',
 'vin': None,
 'year': 2023}
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982403%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [ayvens.be] INFO: Saving data for 1982403: {'created_time': 1774478923.202445, 'last_price_update_time': 1774478923.202456, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982403') HTTP/1.1" 204 0
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/9.jpg not downloaded yet
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/10.jpg not downloaded yet
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21511650>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/5.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9bcd0>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/8.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4e10>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/6.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21511650>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/7.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bab2d0>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/1.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [ayvens.be] INFO: Found listing with ID: 1982406
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982406%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [ayvens.be] INFO: Scrape type for 1982406: 1
2026-03-25 22:48:43 [ayvens.be] INFO: Extracting data for car ID: 1982406
2026-03-25 22:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-25 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e910e974-6374-5dda-9733-e36da3fef1f7 with scrape type 1
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/1.jpg not downloaded yet
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/2.jpg not downloaded yet
2026-03-25 22:48:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289eb9d0>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Ffb62d5a2e45b45e1983fc216fbca6b53%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/2.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6
2026-03-25 22:48:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6, skipping ID generation
2026-03-25 22:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with scrape type 1
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 sending to next pipeline
2026-03-25 22:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6, identifier: 1982188
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21522e50>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/10.jpg saved to cache
2026-03-25 22:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23dd0>
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/10.jpg saved to cache
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c8d10>
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/1.jpg saved to cache
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/3.jpg not downloaded yet
2026-03-25 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with identifier: 1982188
2026-03-25 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with identifier: 1982188
2026-03-25 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 329b8791-aa89-5fb1-8b8c-8066eb46dbf6 with identifier: 1982188 to the API
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '329b8791-aa89-5fb1-8b8c-8066eb46dbf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 911733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_329b8791-aa89-5fb1-8b8c-8066eb46dbf6/329b8791-aa89-5fb1-8b8c-8066eb46dbf6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/fb62d5a2e45b45e1983fc216fbca6b53/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982188%27 HTTP/1.1" 200 None
2026-03-25 22:48:44 [ayvens.be] INFO: Saving data for 1982188: {'created_time': 1774478924.383199, 'last_price_update_time': 1774478924.383208, 'auction_closing_time': 1775037600.0}
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982188') HTTP/1.1" 204 0
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/4.jpg not downloaded yet
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/5.jpg not downloaded yet
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669b90>
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F546030029ff841fe8799f73cf4e0e1d6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/9.jpg saved to cache
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a
2026-03-25 22:48:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a, skipping ID generation
2026-03-25 22:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with scrape type 1
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a sending to next pipeline
2026-03-25 22:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a, identifier: 1982404
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668350>
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/2.jpg saved to cache
2026-03-25 22:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-25 22:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404
2026-03-25 22:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a with identifier: 1982404 to the API
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 121708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a/27fe8baa-77e9-5ffa-9c7d-b8fc3dc4048a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/546030029ff841fe8799f73cf4e0e1d6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0 D150 R-DYNAMIC AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 D150 R-DYNAMIC AUTO 4WD',
 'vin': None,
 'year': 2020}
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982404%27 HTTP/1.1" 200 None
2026-03-25 22:48:45 [ayvens.be] INFO: Saving data for 1982404: {'created_time': 1774478925.03607, 'last_price_update_time': 1774478925.03608, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982404') HTTP/1.1" 204 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/6.jpg not downloaded yet
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/7.jpg not downloaded yet
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892cd50>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/9.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d34e10>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/8.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5e4d0>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/4.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c0810>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/5.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23644950>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/7.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28905350>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fk%252F57647e783ddc4a83800109abe943dd86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/1.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b
2026-03-25 22:48:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b, skipping ID generation
2026-03-25 22:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with scrape type 1
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b sending to next pipeline
2026-03-25 22:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b, identifier: 1982187
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6ce90>
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/3.jpg saved to cache
2026-03-25 22:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/8.jpg not downloaded yet
2026-03-25 22:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with identifier: 1982187
2026-03-25 22:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with identifier: 1982187
2026-03-25 22:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 07e8d4ff-11ab-53a1-b1c3-850dab9faa8b with identifier: 1982187 to the API
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '07e8d4ff-11ab-53a1-b1c3-850dab9faa8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 23857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07e8d4ff-11ab-53a1-b1c3-850dab9faa8b/07e8d4ff-11ab-53a1-b1c3-850dab9faa8b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fk/57647e783ddc4a83800109abe943dd86/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982187%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [ayvens.be] INFO: Saving data for 1982187: {'created_time': 1774478926.325318, 'last_price_update_time': 1774478926.325327, 'auction_closing_time': 1775037600.0}
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982187') HTTP/1.1" 204 0
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/9.jpg not downloaded yet
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/10.jpg not downloaded yet
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [ayvens.be] INFO: Found listing with ID: 1982407
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982407%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [ayvens.be] INFO: Scrape type for 1982407: 1
2026-03-25 22:48:46 [ayvens.be] INFO: Extracting data for car ID: 1982407
2026-03-25 22:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-25 22:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c619667-3703-5ceb-a897-1306aca506b1 with scrape type 1
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/1.jpg not downloaded yet
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/2.jpg not downloaded yet
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/3.jpg not downloaded yet
2026-03-25 22:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/4.jpg not downloaded yet
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362c790>
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/6.jpg saved to cache
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b6350>
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/7.jpg saved to cache
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/5.jpg not downloaded yet
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/6.jpg not downloaded yet
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/7.jpg not downloaded yet
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150b0d0>
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/10.jpg saved to cache
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fdb90>
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/9.jpg saved to cache
2026-03-25 22:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363f1d0>
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/10.jpg saved to cache
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64bf10>
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F9232aff72da74b32bf0915be56eeb11a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/8.jpg saved to cache
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6
2026-03-25 22:48:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70e69321-2ce2-5a6a-9c60-833ed997f9d6, skipping ID generation
2026-03-25 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with scrape type 1
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70e69321-2ce2-5a6a-9c60-833ed997f9d6 sending to next pipeline
2026-03-25 22:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e69321-2ce2-5a6a-9c60-833ed997f9d6, identifier: 1982405
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21528a50>
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/8.jpg saved to cache
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23691f90>
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/9.jpg saved to cache
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-25 22:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405
2026-03-25 22:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e69321-2ce2-5a6a-9c60-833ed997f9d6 with identifier: 1982405 to the API
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '70e69321-2ce2-5a6a-9c60-833ed997f9d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 138884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70e69321-2ce2-5a6a-9c60-833ed997f9d6/70e69321-2ce2-5a6a-9c60-833ed997f9d6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/9232aff72da74b32bf0915be56eeb11a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982405%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [ayvens.be] INFO: Saving data for 1982405: {'created_time': 1774478927.726232, 'last_price_update_time': 1774478927.726243, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982405') HTTP/1.1" 204 0
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/8.jpg not downloaded yet
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/9.jpg not downloaded yet
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/10.jpg not downloaded yet
2026-03-25 22:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:47 [ayvens.be] INFO: Found listing with ID: 1982408
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982408%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [ayvens.be] INFO: Scrape type for 1982408: 1
2026-03-25 22:48:47 [ayvens.be] INFO: Extracting data for car ID: 1982408
2026-03-25 22:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-25 22:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1052ef-ada9-538b-848f-e28c0c901c0e with scrape type 1
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/1.jpg not downloaded yet
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/2.jpg not downloaded yet
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa50d0>
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/1.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/3.jpg not downloaded yet
2026-03-25 22:48:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bcb90>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/4.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/4.jpg not downloaded yet
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/5.jpg not downloaded yet
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b6410>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/3.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288267d0>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/2.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b789d0>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/5.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881fbd0>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/5.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a360290>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F7d9c2699e86f48bfa879c27aa8ade8d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/1.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad8794a1-a37b-591c-be08-fbea5ee690fc
2026-03-25 22:48:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad8794a1-a37b-591c-be08-fbea5ee690fc, skipping ID generation
2026-03-25 22:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8794a1-a37b-591c-be08-fbea5ee690fc with scrape type 1
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad8794a1-a37b-591c-be08-fbea5ee690fc sending to next pipeline
2026-03-25 22:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ad8794a1-a37b-591c-be08-fbea5ee690fc, identifier: 1982186
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880b810>
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/10.jpg saved to cache
2026-03-25 22:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ad8794a1-a37b-591c-be08-fbea5ee690fc with identifier: 1982186
2026-03-25 22:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ad8794a1-a37b-591c-be08-fbea5ee690fc with identifier: 1982186
2026-03-25 22:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ad8794a1-a37b-591c-be08-fbea5ee690fc with identifier: 1982186 to the API
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad8794a1-a37b-591c-be08-fbea5ee690fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 50536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 998523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad8794a1-a37b-591c-be08-fbea5ee690fc/ad8794a1-a37b-591c-be08-fbea5ee690fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/7d9c2699e86f48bfa879c27aa8ade8d1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982186%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [ayvens.be] INFO: Saving data for 1982186: {'created_time': 1774478929.073401, 'last_price_update_time': 1774478929.073411, 'auction_closing_time': 1775037600.0}
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982186') HTTP/1.1" 204 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/6.jpg not downloaded yet
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/7.jpg not downloaded yet
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/8.jpg not downloaded yet
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/9.jpg not downloaded yet
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/10.jpg not downloaded yet
2026-03-25 22:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:49 [ayvens.be] INFO: Found listing with ID: 1982409
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982409%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [ayvens.be] INFO: Scrape type for 1982409: 1
2026-03-25 22:48:49 [ayvens.be] INFO: Extracting data for car ID: 1982409
2026-03-25 22:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-25 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with scrape type 1
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/1.jpg not downloaded yet
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/2.jpg not downloaded yet
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a722ed0>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/8.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881be90>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/10.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f4d0>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/2.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848110>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/1.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7f350>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/6.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884a510>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/9.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/3.jpg not downloaded yet
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c9b10>
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fb0cc0b97167e4dcabd2c4702d7bc479c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/7.jpg saved to cache
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e910e974-6374-5dda-9733-e36da3fef1f7
2026-03-25 22:48:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e910e974-6374-5dda-9733-e36da3fef1f7, skipping ID generation
2026-03-25 22:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e910e974-6374-5dda-9733-e36da3fef1f7 with scrape type 1
2026-03-25 22:48:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e910e974-6374-5dda-9733-e36da3fef1f7 sending to next pipeline
2026-03-25 22:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e910e974-6374-5dda-9733-e36da3fef1f7, identifier: 1982406
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/4.jpg not downloaded yet
2026-03-25 22:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-25 22:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406
2026-03-25 22:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e910e974-6374-5dda-9733-e36da3fef1f7 with identifier: 1982406 to the API
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e910e974-6374-5dda-9733-e36da3fef1f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 140783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e910e974-6374-5dda-9733-e36da3fef1f7/e910e974-6374-5dda-9733-e36da3fef1f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/b0cc0b97167e4dcabd2c4702d7bc479c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982406%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [ayvens.be] INFO: Saving data for 1982406: {'created_time': 1774478930.448604, 'last_price_update_time': 1774478930.448614, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982406') HTTP/1.1" 204 0
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/5.jpg not downloaded yet
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c98d0>
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/3.jpg saved to cache
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/6.jpg not downloaded yet
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/7.jpg not downloaded yet
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/8.jpg not downloaded yet
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/9.jpg not downloaded yet
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/10.jpg not downloaded yet
2026-03-25 22:48:50 [ayvens.be] INFO: Found listing with ID: 1982410
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982410%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [ayvens.be] INFO: Scrape type for 1982410: 1
2026-03-25 22:48:50 [ayvens.be] INFO: Extracting data for car ID: 1982410
2026-03-25 22:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-25 22:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780346eb-a86a-53fd-99c7-cbd67cdb7646 with scrape type 1
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/1.jpg not downloaded yet
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362fdd0>
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/5.jpg saved to cache
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/2.jpg not downloaded yet
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23691510>
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/8.jpg saved to cache
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f5c90>
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/4.jpg saved to cache
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/3.jpg not downloaded yet
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/4.jpg not downloaded yet
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68490>
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/3.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bbc90>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/6.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6df50>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/9.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b9810>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/7.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28743810>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/9.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/5.jpg not downloaded yet
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/6.jpg not downloaded yet
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/7.jpg not downloaded yet
2026-03-25 22:48:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/8.jpg not downloaded yet
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/9.jpg not downloaded yet
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/10.jpg not downloaded yet
2026-03-25 22:48:51 [ayvens.be] INFO: Found listing with ID: 1982411
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982411%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [ayvens.be] INFO: Scrape type for 1982411: 1
2026-03-25 22:48:51 [ayvens.be] INFO: Extracting data for car ID: 1982411
2026-03-25 22:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-25 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa9b692c-89e8-5265-a8a8-58748501fb04 with scrape type 1
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/1.jpg not downloaded yet
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/2.jpg not downloaded yet
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a6aed0>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/5.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23ad0>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/7.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817b10>
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F144f26d132ae4bcc9dc9c98a84b8aa4c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/10.jpg saved to cache
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c619667-3703-5ceb-a897-1306aca506b1
2026-03-25 22:48:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c619667-3703-5ceb-a897-1306aca506b1, skipping ID generation
2026-03-25 22:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c619667-3703-5ceb-a897-1306aca506b1 with scrape type 1
2026-03-25 22:48:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c619667-3703-5ceb-a897-1306aca506b1 sending to next pipeline
2026-03-25 22:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c619667-3703-5ceb-a897-1306aca506b1, identifier: 1982407
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b70d0>
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/6.jpg saved to cache
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23692910>
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/1.jpg saved to cache
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21501f90>
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/2.jpg saved to cache
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b9190>
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/4.jpg saved to cache
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/3.jpg not downloaded yet
2026-03-25 22:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-25 22:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407
2026-03-25 22:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c619667-3703-5ceb-a897-1306aca506b1 with identifier: 1982407 to the API
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5c619667-3703-5ceb-a897-1306aca506b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 129057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c619667-3703-5ceb-a897-1306aca506b1/5c619667-3703-5ceb-a897-1306aca506b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/144f26d132ae4bcc9dc9c98a84b8aa4c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 D3 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '2.0 D3 MOMENTUM CORE',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982407%27 HTTP/1.1" 200 None
2026-03-25 22:48:52 [ayvens.be] INFO: Saving data for 1982407: {'created_time': 1774478932.938344, 'last_price_update_time': 1774478932.938356, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982407') HTTP/1.1" 204 0
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aee490>
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/3.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/4.jpg not downloaded yet
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/5.jpg not downloaded yet
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/6.jpg not downloaded yet
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/7.jpg not downloaded yet
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/8.jpg not downloaded yet
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/9.jpg not downloaded yet
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/10.jpg not downloaded yet
2026-03-25 22:48:53 [ayvens.be] INFO: Found listing with ID: 1982412
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982412%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [ayvens.be] INFO: Scrape type for 1982412: 1
2026-03-25 22:48:53 [ayvens.be] INFO: Extracting data for car ID: 1982412
2026-03-25 22:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-25 22:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca083a9-7be3-5cf8-b5bc-2102e83d9845 with scrape type 1
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/1.jpg not downloaded yet
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892f150>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/5.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bf3d0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/4.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/2.jpg not downloaded yet
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/3.jpg not downloaded yet
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876c1d0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/2.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287665d0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/2.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1d790>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/9.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fefd0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/10.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368a8d0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/6.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ca3d0>
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/1.jpg saved to cache
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/4.jpg not downloaded yet
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/5.jpg not downloaded yet
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/6.jpg not downloaded yet
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/7.jpg not downloaded yet
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/8.jpg not downloaded yet
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/9.jpg not downloaded yet
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361f7d0>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/4.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fe010>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/3.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/10.jpg not downloaded yet
2026-03-25 22:48:54 [ayvens.be] INFO: Found listing with ID: 1982413
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982413%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [ayvens.be] INFO: Scrape type for 1982413: 1
2026-03-25 22:48:54 [ayvens.be] INFO: Extracting data for car ID: 1982413
2026-03-25 22:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-25 22:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cba5fde-1672-50fe-b5a0-858d155d4385 with scrape type 1
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/1.jpg not downloaded yet
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/2.jpg not downloaded yet
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21511490>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/1.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749c50>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/5.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236dba90>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/10.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d9c50>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/3.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23640990>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/6.jpg saved to cache
2026-03-25 22:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28824210>
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/9.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/3.jpg not downloaded yet
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/4.jpg not downloaded yet
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/5.jpg not downloaded yet
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/6.jpg not downloaded yet
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/7.jpg not downloaded yet
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/8.jpg not downloaded yet
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2bdf9550>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/4.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881c5d0>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/1.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/9.jpg not downloaded yet
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/10.jpg not downloaded yet
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [ayvens.be] INFO: Found listing with ID: 1982414
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982414%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [ayvens.be] INFO: Scrape type for 1982414: 1
2026-03-25 22:48:55 [ayvens.be] INFO: Extracting data for car ID: 1982414
2026-03-25 22:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-25 22:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with scrape type 1
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/1.jpg not downloaded yet
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e9b90>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/10.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa27d0>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/9.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ebd90>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/5.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fe8d0>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/8.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28907210>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/2.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9a90>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/1.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/2.jpg not downloaded yet
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/3.jpg not downloaded yet
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa3050>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/4.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ccfd0>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/3.jpg saved to cache
2026-03-25 22:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515450>
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/5.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9c50>
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/6.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/4.jpg not downloaded yet
2026-03-25 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/5.jpg not downloaded yet
2026-03-25 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/6.jpg not downloaded yet
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a95450>
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/2.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb5690>
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/7.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a512d0>
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F6df317f10103450399e7759e6ba12e5b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/6.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa9b692c-89e8-5265-a8a8-58748501fb04
2026-03-25 22:48:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa9b692c-89e8-5265-a8a8-58748501fb04, skipping ID generation
2026-03-25 22:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa9b692c-89e8-5265-a8a8-58748501fb04 with scrape type 1
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa9b692c-89e8-5265-a8a8-58748501fb04 sending to next pipeline
2026-03-25 22:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa9b692c-89e8-5265-a8a8-58748501fb04, identifier: 1982411
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23691790>
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/2.jpg saved to cache
2026-03-25 22:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-25 22:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411
2026-03-25 22:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa9b692c-89e8-5265-a8a8-58748501fb04 with identifier: 1982411 to the API
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fa9b692c-89e8-5265-a8a8-58748501fb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 124159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa9b692c-89e8-5265-a8a8-58748501fb04/fa9b692c-89e8-5265-a8a8-58748501fb04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/6df317f10103450399e7759e6ba12e5b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2021}
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982411%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [ayvens.be] INFO: Saving data for 1982411: {'created_time': 1774478937.027585, 'last_price_update_time': 1774478937.027596, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982411') HTTP/1.1" 204 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/7.jpg not downloaded yet
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/8.jpg not downloaded yet
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215159d0>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/10.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23641150>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/10.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21519b90>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/1.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669310>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/9.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21518c10>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/3.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/9.jpg not downloaded yet
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/10.jpg not downloaded yet
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ca590>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/5.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2adbead0>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/4.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [ayvens.be] INFO: Found listing with ID: 1982415
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982415%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [ayvens.be] INFO: Scrape type for 1982415: 1
2026-03-25 22:48:57 [ayvens.be] INFO: Extracting data for car ID: 1982415
2026-03-25 22:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-25 22:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with scrape type 1
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/1.jpg not downloaded yet
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/2.jpg not downloaded yet
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28925c90>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/8.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879a4d0>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/9.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28907890>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/1.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825910>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/7.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ac7d0>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/8.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7df50>
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/10.jpg saved to cache
2026-03-25 22:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/3.jpg not downloaded yet
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/4.jpg not downloaded yet
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/5.jpg not downloaded yet
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825a50>
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/2.jpg saved to cache
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28755350>
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fe7bc7120d18a4fe29d5a58efa03c1411%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/6.jpg saved to cache
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cba5fde-1672-50fe-b5a0-858d155d4385
2026-03-25 22:48:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cba5fde-1672-50fe-b5a0-858d155d4385, skipping ID generation
2026-03-25 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cba5fde-1672-50fe-b5a0-858d155d4385 with scrape type 1
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cba5fde-1672-50fe-b5a0-858d155d4385 sending to next pipeline
2026-03-25 22:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cba5fde-1672-50fe-b5a0-858d155d4385, identifier: 1982413
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901c9d0>
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/3.jpg saved to cache
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ef650>
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/4.jpg saved to cache
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-25 22:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413
2026-03-25 22:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cba5fde-1672-50fe-b5a0-858d155d4385 with identifier: 1982413 to the API
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2cba5fde-1672-50fe-b5a0-858d155d4385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C3 AIRCROSS',
 'odometer': 43054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cba5fde-1672-50fe-b5a0-858d155d4385/2cba5fde-1672-50fe-b5a0-858d155d4385_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/e7bc7120d18a4fe29d5a58efa03c1411/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C3 AIRCROSS 1.2 PURETECH 110 S&S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 110 S&S SHINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982413%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [ayvens.be] INFO: Saving data for 1982413: {'created_time': 1774478938.804357, 'last_price_update_time': 1774478938.804372, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982413') HTTP/1.1" 204 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/6.jpg not downloaded yet
2026-03-25 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/7.jpg not downloaded yet
2026-03-25 22:48:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669bd0>
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wp%252F3518bf01deb34bbe923e49bcac67c359%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/7.jpg saved to cache
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eca083a9-7be3-5cf8-b5bc-2102e83d9845
2026-03-25 22:48:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eca083a9-7be3-5cf8-b5bc-2102e83d9845, skipping ID generation
2026-03-25 22:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca083a9-7be3-5cf8-b5bc-2102e83d9845 with scrape type 1
2026-03-25 22:48:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eca083a9-7be3-5cf8-b5bc-2102e83d9845 sending to next pipeline
2026-03-25 22:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eca083a9-7be3-5cf8-b5bc-2102e83d9845, identifier: 1982412
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901cfd0>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/5.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/8.jpg not downloaded yet
2026-03-25 22:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-25 22:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412
2026-03-25 22:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eca083a9-7be3-5cf8-b5bc-2102e83d9845 with identifier: 1982412 to the API
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'eca083a9-7be3-5cf8-b5bc-2102e83d9845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Trafic',
 'odometer': 64508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca083a9-7be3-5cf8-b5bc-2102e83d9845/eca083a9-7be3-5cf8-b5bc-2102e83d9845_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wp/3518bf01deb34bbe923e49bcac67c359/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT Trafic 1.6 dCi 29 L1H1 Grand Confort STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L1H1 Grand Confort STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982412%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [ayvens.be] INFO: Saving data for 1982412: {'created_time': 1774478939.530747, 'last_price_update_time': 1774478939.530758, 'auction_closing_time': 1774942200.0}
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982412') HTTP/1.1" 204 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/9.jpg not downloaded yet
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2fed0>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/7.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f73d0>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/9.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877f7d0>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/6.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b7610>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/8.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/10.jpg not downloaded yet
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a713bd0>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/8.jpg saved to cache
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [ayvens.be] INFO: Found listing with ID: 1982416
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982416%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [ayvens.be] INFO: Scrape type for 1982416: 1
2026-03-25 22:48:59 [ayvens.be] INFO: Extracting data for car ID: 1982416
2026-03-25 22:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-25 22:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff5731d-2d02-541f-82f9-3cbff49e8496 with scrape type 1
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/1.jpg not downloaded yet
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/2.jpg not downloaded yet
2026-03-25 22:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/3.jpg not downloaded yet
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9650>
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:48:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:48:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2af%252Fe892214417ed49e3b5d11c38b496f316%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/7.jpg saved to cache
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 780346eb-a86a-53fd-99c7-cbd67cdb7646
2026-03-25 22:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 780346eb-a86a-53fd-99c7-cbd67cdb7646, skipping ID generation
2026-03-25 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 780346eb-a86a-53fd-99c7-cbd67cdb7646 with scrape type 1
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 780346eb-a86a-53fd-99c7-cbd67cdb7646 sending to next pipeline
2026-03-25 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 780346eb-a86a-53fd-99c7-cbd67cdb7646, identifier: 1982410
2026-03-25 22:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-25 22:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410
2026-03-25 22:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 780346eb-a86a-53fd-99c7-cbd67cdb7646 with identifier: 1982410 to the API
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '780346eb-a86a-53fd-99c7-cbd67cdb7646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 127744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_780346eb-a86a-53fd-99c7-cbd67cdb7646/780346eb-a86a-53fd-99c7-cbd67cdb7646_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2af/e892214417ed49e3b5d11c38b496f316/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982410%27 HTTP/1.1" 200 None
2026-03-25 22:49:00 [ayvens.be] INFO: Saving data for 1982410: {'created_time': 1774478940.548088, 'last_price_update_time': 1774478940.548099, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982410') HTTP/1.1" 204 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/4.jpg not downloaded yet
2026-03-25 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/5.jpg not downloaded yet
2026-03-25 22:49:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a6810>
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/7.jpg saved to cache
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ca750>
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/9.jpg saved to cache
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901f1d0>
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252Fa99ec07d1e5f4dc5aed54c5b8782580e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/10.jpg saved to cache
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1
2026-03-25 22:49:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3a18270-df83-5ed1-9fcc-5a876d1d24c1, skipping ID generation
2026-03-25 22:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with scrape type 1
2026-03-25 22:49:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3a18270-df83-5ed1-9fcc-5a876d1d24c1 sending to next pipeline
2026-03-25 22:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3a18270-df83-5ed1-9fcc-5a876d1d24c1, identifier: 1982414
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1dd50>
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F1f2687a72363472dbf156a1790d0cf3d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/8.jpg saved to cache
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0
2026-03-25 22:49:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0, skipping ID generation
2026-03-25 22:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with scrape type 1
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 sending to next pipeline
2026-03-25 22:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0, identifier: 1982409
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ea1d0>
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/1.jpg saved to cache
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/6.jpg not downloaded yet
2026-03-25 22:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-25 22:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414
2026-03-25 22:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3a18270-df83-5ed1-9fcc-5a876d1d24c1 with identifier: 1982414 to the API
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a3a18270-df83-5ed1-9fcc-5a876d1d24c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL S',
 'odometer': 49783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3a18270-df83-5ed1-9fcc-5a876d1d24c1/a3a18270-df83-5ed1-9fcc-5a876d1d24c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/a99ec07d1e5f4dc5aed54c5b8782580e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL S BEV ALL-WHEEL DRIVE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV ALL-WHEEL DRIVE AUTO',
 'vin': None,
 'year': 2024}
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982414%27 HTTP/1.1" 200 None
2026-03-25 22:49:01 [ayvens.be] INFO: Saving data for 1982414: {'created_time': 1774478941.505813, 'last_price_update_time': 1774478941.505824, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982414') HTTP/1.1" 204 0
2026-03-25 22:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-25 22:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409
2026-03-25 22:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328bbf9e-7c19-5f79-ad3e-88f11e2a78b0 with identifier: 1982409 to the API
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '328bbf9e-7c19-5f79-ad3e-88f11e2a78b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'S60 - 2019',
 'odometer': 130116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328bbf9e-7c19-5f79-ad3e-88f11e2a78b0/328bbf9e-7c19-5f79-ad3e-88f11e2a78b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/1f2687a72363472dbf156a1790d0cf3d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO S60 - 2019 2.0 T8 AWD PHEV Inscription',
 'transmission': 'automatic',
 'trim': '2.0 T8 AWD PHEV Inscription',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982409%27 HTTP/1.1" 200 None
2026-03-25 22:49:01 [ayvens.be] INFO: Saving data for 1982409: {'created_time': 1774478941.858141, 'last_price_update_time': 1774478941.85815, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982409') HTTP/1.1" 204 0
2026-03-25 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/7.jpg not downloaded yet
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878b8d0>
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7ee525d85a2641fe99b5e268e127a520%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/8.jpg saved to cache
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d1052ef-ada9-538b-848f-e28c0c901c0e
2026-03-25 22:49:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d1052ef-ada9-538b-848f-e28c0c901c0e, skipping ID generation
2026-03-25 22:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1052ef-ada9-538b-848f-e28c0c901c0e with scrape type 1
2026-03-25 22:49:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d1052ef-ada9-538b-848f-e28c0c901c0e sending to next pipeline
2026-03-25 22:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d1052ef-ada9-538b-848f-e28c0c901c0e, identifier: 1982408
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b790>
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/8.jpg saved to cache
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-25 22:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408
2026-03-25 22:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d1052ef-ada9-538b-848f-e28c0c901c0e with identifier: 1982408 to the API
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '2d1052ef-ada9-538b-848f-e28c0c901c0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 140135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1052ef-ada9-538b-848f-e28c0c901c0e/2d1052ef-ada9-538b-848f-e28c0c901c0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7ee525d85a2641fe99b5e268e127a520/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV AUTO RWD',
 'transmission': 'automatic',
 'trim': 'BEV AUTO RWD',
 'vin': None,
 'year': 2023}
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982408%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [ayvens.be] INFO: Saving data for 1982408: {'created_time': 1774478942.469826, 'last_price_update_time': 1774478942.469835, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982408') HTTP/1.1" 204 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/8.jpg not downloaded yet
2026-03-25 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/9.jpg not downloaded yet
2026-03-25 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28dfa9d0>
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/6.jpg saved to cache
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23644610>
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/5.jpg saved to cache
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/10.jpg not downloaded yet
2026-03-25 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:02 [ayvens.be] INFO: Found listing with ID: 1982417
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982417%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [ayvens.be] INFO: Scrape type for 1982417: 1
2026-03-25 22:49:02 [ayvens.be] INFO: Extracting data for car ID: 1982417
2026-03-25 22:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-25 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4139ed62-7b28-5253-bc5c-ace461473fc1 with scrape type 1
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/1.jpg not downloaded yet
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516450>
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/1.jpg saved to cache
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7f790>
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F0da7443dc8c04a6892ad53d16ec46699%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/7.jpg saved to cache
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de731b42-2069-5e3b-aae1-2fe285443964
2026-03-25 22:49:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de731b42-2069-5e3b-aae1-2fe285443964, skipping ID generation
2026-03-25 22:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de731b42-2069-5e3b-aae1-2fe285443964 with scrape type 1
2026-03-25 22:49:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de731b42-2069-5e3b-aae1-2fe285443964 sending to next pipeline
2026-03-25 22:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de731b42-2069-5e3b-aae1-2fe285443964, identifier: 1982185
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a723f10>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/4.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de731b42-2069-5e3b-aae1-2fe285443964 with identifier: 1982185
2026-03-25 22:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de731b42-2069-5e3b-aae1-2fe285443964 with identifier: 1982185
2026-03-25 22:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de731b42-2069-5e3b-aae1-2fe285443964 with identifier: 1982185 to the API
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de731b42-2069-5e3b-aae1-2fe285443964',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 84060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de731b42-2069-5e3b-aae1-2fe285443964/de731b42-2069-5e3b-aae1-2fe285443964_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/0da7443dc8c04a6892ad53d16ec46699/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982185%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [ayvens.be] INFO: Saving data for 1982185: {'created_time': 1774478943.402906, 'last_price_update_time': 1774478943.402917, 'auction_closing_time': 1775037600.0}
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982185') HTTP/1.1" 204 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/2.jpg not downloaded yet
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/3.jpg not downloaded yet
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878b8d0>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/3.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f3f90>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/7.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc42d0>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/8.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901cbd0>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/9.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/4.jpg not downloaded yet
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/5.jpg not downloaded yet
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2152b650>
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/10.jpg saved to cache
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/6.jpg not downloaded yet
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/7.jpg not downloaded yet
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/8.jpg not downloaded yet
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/9.jpg not downloaded yet
2026-03-25 22:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/10.jpg not downloaded yet
2026-03-25 22:49:03 [ayvens.be] INFO: Found listing with ID: 1982418
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982418%27 HTTP/1.1" 200 None
2026-03-25 22:49:03 [ayvens.be] INFO: Scrape type for 1982418: 1
2026-03-25 22:49:03 [ayvens.be] INFO: Extracting data for car ID: 1982418
2026-03-25 22:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-25 22:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b481e7-4718-5df7-90aa-83f2fdf704b5 with scrape type 1
2026-03-25 22:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/1.jpg not downloaded yet
2026-03-25 22:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/2.jpg not downloaded yet
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a360690>
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/2.jpg saved to cache
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363c6d0>
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/5.jpg saved to cache
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a638090>
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252Fd9283166f4964d3a94126178148bbe42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/2.jpg saved to cache
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074
2026-03-25 22:49:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7b1f6a0-d8dc-5edf-a409-1d12080bf074, skipping ID generation
2026-03-25 22:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with scrape type 1
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7b1f6a0-d8dc-5edf-a409-1d12080bf074 sending to next pipeline
2026-03-25 22:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7b1f6a0-d8dc-5edf-a409-1d12080bf074, identifier: 1982415
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287f5b10>
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/1.jpg saved to cache
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28788f90>
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/6.jpg saved to cache
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/3.jpg not downloaded yet
2026-03-25 22:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-25 22:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415
2026-03-25 22:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7b1f6a0-d8dc-5edf-a409-1d12080bf074 with identifier: 1982415 to the API
2026-03-25 22:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b7b1f6a0-d8dc-5edf-a409-1d12080bf074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 47670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7b1f6a0-d8dc-5edf-a409-1d12080bf074/b7b1f6a0-d8dc-5edf-a409-1d12080bf074_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/d9283166f4964d3a94126178148bbe42/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982415%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [ayvens.be] INFO: Saving data for 1982415: {'created_time': 1774478945.199929, 'last_price_update_time': 1774478945.199982, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982415') HTTP/1.1" 204 0
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/4.jpg not downloaded yet
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150c5d0>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/3.jpg saved to cache
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b48290>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/10.jpg saved to cache
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23689790>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/4.jpg saved to cache
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b6bd0>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/9.jpg saved to cache
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/5.jpg not downloaded yet
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/6.jpg not downloaded yet
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884ad90>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/10.jpg saved to cache
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/7.jpg not downloaded yet
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/8.jpg not downloaded yet
2026-03-25 22:49:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/9.jpg not downloaded yet
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad350>
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/7.jpg saved to cache
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e43b10>
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/1.jpg saved to cache
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880a0d0>
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252Fd6dca2da89f643aa9760109c39a3be4f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/8.jpg saved to cache
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aff5731d-2d02-541f-82f9-3cbff49e8496
2026-03-25 22:49:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff5731d-2d02-541f-82f9-3cbff49e8496, skipping ID generation
2026-03-25 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff5731d-2d02-541f-82f9-3cbff49e8496 with scrape type 1
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aff5731d-2d02-541f-82f9-3cbff49e8496 sending to next pipeline
2026-03-25 22:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aff5731d-2d02-541f-82f9-3cbff49e8496, identifier: 1982416
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7d550>
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/5.jpg saved to cache
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-25 22:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416
2026-03-25 22:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aff5731d-2d02-541f-82f9-3cbff49e8496 with identifier: 1982416 to the API
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'aff5731d-2d02-541f-82f9-3cbff49e8496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 62724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff5731d-2d02-541f-82f9-3cbff49e8496/aff5731d-2d02-541f-82f9-3cbff49e8496_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/d6dca2da89f643aa9760109c39a3be4f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982416%27 HTTP/1.1" 200 None
2026-03-25 22:49:06 [ayvens.be] INFO: Saving data for 1982416: {'created_time': 1774478946.803706, 'last_price_update_time': 1774478946.803718, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982416') HTTP/1.1" 204 0
2026-03-25 22:49:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -1 pages/min), scraped 119 items (at 40 items/min)
2026-03-25 22:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/10.jpg not downloaded yet
2026-03-25 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:06 [ayvens.be] INFO: Found listing with ID: 1982419
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982419%27 HTTP/1.1" 200 None
2026-03-25 22:49:06 [ayvens.be] INFO: Scrape type for 1982419: 1
2026-03-25 22:49:06 [ayvens.be] INFO: Extracting data for car ID: 1982419
2026-03-25 22:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-25 22:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with scrape type 1
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/1.jpg not downloaded yet
2026-03-25 22:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848610>
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/7.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7d750>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/9.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926210>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/8.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/2.jpg not downloaded yet
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/3.jpg not downloaded yet
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369d250>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/4.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28743390>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/3.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892c190>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/2.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/4.jpg not downloaded yet
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/5.jpg not downloaded yet
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/6.jpg not downloaded yet
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/7.jpg not downloaded yet
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/8.jpg not downloaded yet
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/9.jpg not downloaded yet
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/10.jpg not downloaded yet
2026-03-25 22:49:07 [ayvens.be] INFO: Found listing with ID: 1982420
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982420%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [ayvens.be] INFO: Scrape type for 1982420: 1
2026-03-25 22:49:07 [ayvens.be] INFO: Extracting data for car ID: 1982420
2026-03-25 22:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-25 22:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with scrape type 1
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/1.jpg not downloaded yet
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b98fd0>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/7.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288aed50>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/3.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/2.jpg not downloaded yet
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884be50>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/6.jpg saved to cache
2026-03-25 22:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e8450>
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/8.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369f810>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/6.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a3552d0>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/2.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/3.jpg not downloaded yet
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/4.jpg not downloaded yet
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa23d0>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/1.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b7150>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/4.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/5.jpg not downloaded yet
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/6.jpg not downloaded yet
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ba110>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/5.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/7.jpg not downloaded yet
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/8.jpg not downloaded yet
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/9.jpg not downloaded yet
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6eb90>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/6.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/10.jpg not downloaded yet
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21518f90>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/10.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:08 [ayvens.be] INFO: Found listing with ID: 1982421
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982421%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [ayvens.be] INFO: Scrape type for 1982421: 1
2026-03-25 22:49:08 [ayvens.be] INFO: Extracting data for car ID: 1982421
2026-03-25 22:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-25 22:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a0a085-2c82-5c07-9ec5-ee5f85858273 with scrape type 1
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/1.jpg not downloaded yet
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150af90>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/7.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668510>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/8.jpg saved to cache
2026-03-25 22:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa4f10>
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/10.jpg saved to cache
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bd510>
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F8e1e5e4357f44b74a619973b392d935c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/9.jpg saved to cache
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28b481e7-4718-5df7-90aa-83f2fdf704b5
2026-03-25 22:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28b481e7-4718-5df7-90aa-83f2fdf704b5, skipping ID generation
2026-03-25 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b481e7-4718-5df7-90aa-83f2fdf704b5 with scrape type 1
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28b481e7-4718-5df7-90aa-83f2fdf704b5 sending to next pipeline
2026-03-25 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28b481e7-4718-5df7-90aa-83f2fdf704b5, identifier: 1982418
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7790>
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F1f8dc33a5a8c49838e967093f0200848%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/9.jpg saved to cache
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4139ed62-7b28-5253-bc5c-ace461473fc1
2026-03-25 22:49:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4139ed62-7b28-5253-bc5c-ace461473fc1, skipping ID generation
2026-03-25 22:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4139ed62-7b28-5253-bc5c-ace461473fc1 with scrape type 1
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4139ed62-7b28-5253-bc5c-ace461473fc1 sending to next pipeline
2026-03-25 22:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4139ed62-7b28-5253-bc5c-ace461473fc1, identifier: 1982417
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/2.jpg not downloaded yet
2026-03-25 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-25 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418
2026-03-25 22:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28b481e7-4718-5df7-90aa-83f2fdf704b5 with identifier: 1982418 to the API
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '28b481e7-4718-5df7-90aa-83f2fdf704b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 35405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b481e7-4718-5df7-90aa-83f2fdf704b5/28b481e7-4718-5df7-90aa-83f2fdf704b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/8e1e5e4357f44b74a619973b392d935c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982418%27 HTTP/1.1" 200 None
2026-03-25 22:49:09 [ayvens.be] INFO: Saving data for 1982418: {'created_time': 1774478949.914022, 'last_price_update_time': 1774478949.914032, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982418') HTTP/1.1" 204 0
2026-03-25 22:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-25 22:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417
2026-03-25 22:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4139ed62-7b28-5253-bc5c-ace461473fc1 with identifier: 1982417 to the API
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4139ed62-7b28-5253-bc5c-ace461473fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 62348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 813293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4139ed62-7b28-5253-bc5c-ace461473fc1/4139ed62-7b28-5253-bc5c-ace461473fc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 941462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/1f8dc33a5a8c49838e967093f0200848/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 1.0 TCE 100 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 100 CORPORATE EDITION',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982417%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [ayvens.be] INFO: Saving data for 1982417: {'created_time': 1774478950.27522, 'last_price_update_time': 1774478950.275229, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982417') HTTP/1.1" 204 0
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/3.jpg not downloaded yet
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a75c890>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/2.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21516a10>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/1.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/4.jpg not downloaded yet
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/5.jpg not downloaded yet
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aedc10>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/3.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/6.jpg not downloaded yet
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/7.jpg not downloaded yet
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/8.jpg not downloaded yet
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e04d0>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/3.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790f10>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/4.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7e490>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/5.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/9.jpg not downloaded yet
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/10.jpg not downloaded yet
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f8d90>
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fa9d1d99a200f45ecbd193d1b8feb3b5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/1.jpg saved to cache
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e
2026-03-25 22:49:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78d722ae-23bd-5dd0-a97a-a1342013ba0e, skipping ID generation
2026-03-25 22:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e with scrape type 1
2026-03-25 22:49:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78d722ae-23bd-5dd0-a97a-a1342013ba0e sending to next pipeline
2026-03-25 22:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 78d722ae-23bd-5dd0-a97a-a1342013ba0e, identifier: 1982184
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0d1d0>
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/5.jpg saved to cache
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7c450>
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/2.jpg saved to cache
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21509d50>
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/1.jpg saved to cache
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fd850>
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/4.jpg saved to cache
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:11 [ayvens.be] INFO: Found listing with ID: 1982422
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982422%27 HTTP/1.1" 200 None
2026-03-25 22:49:11 [ayvens.be] INFO: Scrape type for 1982422: 1
2026-03-25 22:49:11 [ayvens.be] INFO: Extracting data for car ID: 1982422
2026-03-25 22:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-25 22:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de54aad0-1892-529e-8816-f49bbdf46b03 with scrape type 1
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/1.jpg not downloaded yet
2026-03-25 22:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 78d722ae-23bd-5dd0-a97a-a1342013ba0e with identifier: 1982184
2026-03-25 22:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 78d722ae-23bd-5dd0-a97a-a1342013ba0e with identifier: 1982184
2026-03-25 22:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 78d722ae-23bd-5dd0-a97a-a1342013ba0e with identifier: 1982184 to the API
2026-03-25 22:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '78d722ae-23bd-5dd0-a97a-a1342013ba0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 75045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645351,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 918209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 949848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d722ae-23bd-5dd0-a97a-a1342013ba0e/78d722ae-23bd-5dd0-a97a-a1342013ba0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 922354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/a9d1d99a200f45ecbd193d1b8feb3b5d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982184%27 HTTP/1.1" 200 None
2026-03-25 22:49:12 [ayvens.be] INFO: Saving data for 1982184: {'created_time': 1774478952.676867, 'last_price_update_time': 1774478952.676877, 'auction_closing_time': 1775037600.0}
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982184') HTTP/1.1" 204 0
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/2.jpg not downloaded yet
2026-03-25 22:49:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/3.jpg not downloaded yet
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288197d0>
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/9.jpg saved to cache
2026-03-25 22:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7f010>
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/7.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b4590>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/6.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881db50>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/8.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cbed0>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F449aca0a07fb4bc1826c4a49b41afe40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/10.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff
2026-03-25 22:49:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff, skipping ID generation
2026-03-25 22:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with scrape type 1
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff sending to next pipeline
2026-03-25 22:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff, identifier: 1982420
2026-03-25 22:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-25 22:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420
2026-03-25 22:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff with identifier: 1982420 to the API
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 121821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff/fd93bbc2-8fc6-58aa-bd77-ab39fbf7acff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/449aca0a07fb4bc1826c4a49b41afe40/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982420%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [ayvens.be] INFO: Saving data for 1982420: {'created_time': 1774478953.595732, 'last_price_update_time': 1774478953.595748, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982420') HTTP/1.1" 204 0
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/4.jpg not downloaded yet
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b4b690>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/10.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/5.jpg not downloaded yet
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/6.jpg not downloaded yet
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23624a90>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/1.jpg saved to cache
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/7.jpg not downloaded yet
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/8.jpg not downloaded yet
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/9.jpg not downloaded yet
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a220d0>
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/2.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b7c10>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/3.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df94d0>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/9.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/10.jpg not downloaded yet
2026-03-25 22:49:14 [ayvens.be] INFO: Found listing with ID: 1982423
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982423%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [ayvens.be] INFO: Scrape type for 1982423: 1
2026-03-25 22:49:14 [ayvens.be] INFO: Extracting data for car ID: 1982423
2026-03-25 22:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-25 22:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with scrape type 1
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/1.jpg not downloaded yet
2026-03-25 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361cc10>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/4.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ffd0>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/5.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa5a10>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/8.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/2.jpg not downloaded yet
2026-03-25 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/3.jpg not downloaded yet
2026-03-25 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/4.jpg not downloaded yet
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368eb90>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/7.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e43ed0>
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F85e4a0de1e91496595b2368c393075ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/6.jpg saved to cache
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6
2026-03-25 22:49:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6, skipping ID generation
2026-03-25 22:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with scrape type 1
2026-03-25 22:49:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 sending to next pipeline
2026-03-25 22:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6, identifier: 1982419
2026-03-25 22:49:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-25 22:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419
2026-03-25 22:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 667dd1e2-a658-5df0-b59d-4f13d7fb61a6 with identifier: 1982419 to the API
2026-03-25 22:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '667dd1e2-a658-5df0-b59d-4f13d7fb61a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 74873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_667dd1e2-a658-5df0-b59d-4f13d7fb61a6/667dd1e2-a658-5df0-b59d-4f13d7fb61a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/85e4a0de1e91496595b2368c393075ea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982419%27 HTTP/1.1" 200 None
2026-03-25 22:49:15 [ayvens.be] INFO: Saving data for 1982419: {'created_time': 1774478955.18062, 'last_price_update_time': 1774478955.180631, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982419') HTTP/1.1" 204 0
2026-03-25 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/5.jpg not downloaded yet
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/6.jpg not downloaded yet
2026-03-25 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0e790>
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/7.jpg saved to cache
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aee450>
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/9.jpg saved to cache
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c108d0>
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/6.jpg saved to cache
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/7.jpg not downloaded yet
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/8.jpg not downloaded yet
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28791a10>
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/8.jpg saved to cache
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848610>
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F29c0ee8968374496abc7afd7fe3ff702%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/10.jpg saved to cache
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82a0a085-2c82-5c07-9ec5-ee5f85858273
2026-03-25 22:49:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82a0a085-2c82-5c07-9ec5-ee5f85858273, skipping ID generation
2026-03-25 22:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a0a085-2c82-5c07-9ec5-ee5f85858273 with scrape type 1
2026-03-25 22:49:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82a0a085-2c82-5c07-9ec5-ee5f85858273 sending to next pipeline
2026-03-25 22:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82a0a085-2c82-5c07-9ec5-ee5f85858273, identifier: 1982421
2026-03-25 22:49:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-25 22:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421
2026-03-25 22:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82a0a085-2c82-5c07-9ec5-ee5f85858273 with identifier: 1982421 to the API
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '82a0a085-2c82-5c07-9ec5-ee5f85858273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 152919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a0a085-2c82-5c07-9ec5-ee5f85858273/82a0a085-2c82-5c07-9ec5-ee5f85858273_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/29c0ee8968374496abc7afd7fe3ff702/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.2 PURETECH 130 S&S AUTO GT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S AUTO GT',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982421%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [ayvens.be] INFO: Saving data for 1982421: {'created_time': 1774478956.306955, 'last_price_update_time': 1774478956.306965, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982421') HTTP/1.1" 204 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/9.jpg not downloaded yet
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/10.jpg not downloaded yet
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c81d0>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/2.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb6cd0>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/10.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:49:16 [ayvens.be] INFO: Found listing with ID: 1982424
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982424%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [ayvens.be] INFO: Scrape type for 1982424: 1
2026-03-25 22:49:16 [ayvens.be] INFO: Extracting data for car ID: 1982424
2026-03-25 22:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-25 22:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b442c974-7063-5b36-a79c-8716b8f0080e with scrape type 1
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/1.jpg not downloaded yet
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/2.jpg not downloaded yet
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ea250>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/3.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814e10>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/4.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ca090>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/1.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/3.jpg not downloaded yet
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/4.jpg not downloaded yet
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0d950>
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/6.jpg saved to cache
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/5.jpg not downloaded yet
2026-03-25 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/6.jpg not downloaded yet
2026-03-25 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/7.jpg not downloaded yet
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a360250>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/5.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23090>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/8.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c3010>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/7.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/8.jpg not downloaded yet
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/9.jpg not downloaded yet
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28793850>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/9.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21518f10>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fe145269573c14ef8a4c627529fd0b6ea%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/10.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de54aad0-1892-529e-8816-f49bbdf46b03
2026-03-25 22:49:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de54aad0-1892-529e-8816-f49bbdf46b03, skipping ID generation
2026-03-25 22:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de54aad0-1892-529e-8816-f49bbdf46b03 with scrape type 1
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de54aad0-1892-529e-8816-f49bbdf46b03 sending to next pipeline
2026-03-25 22:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de54aad0-1892-529e-8816-f49bbdf46b03, identifier: 1982422
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f9150>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/1.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad250>
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/3.jpg saved to cache
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/10.jpg not downloaded yet
2026-03-25 22:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-25 22:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422
2026-03-25 22:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de54aad0-1892-529e-8816-f49bbdf46b03 with identifier: 1982422 to the API
2026-03-25 22:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'de54aad0-1892-529e-8816-f49bbdf46b03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 143478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de54aad0-1892-529e-8816-f49bbdf46b03/de54aad0-1892-529e-8816-f49bbdf46b03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/e145269573c14ef8a4c627529fd0b6ea/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 2.0 35 TDI 110KW S TRONIC BUSINESS EDIT.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 110KW S TRONIC BUSINESS EDIT.',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982422%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [ayvens.be] INFO: Saving data for 1982422: {'created_time': 1774478958.688205, 'last_price_update_time': 1774478958.688216, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982422') HTTP/1.1" 204 0
2026-03-25 22:49:18 [ayvens.be] INFO: Found listing with ID: 1982425
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982425%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [ayvens.be] INFO: Scrape type for 1982425: 1
2026-03-25 22:49:18 [ayvens.be] INFO: Extracting data for car ID: 1982425
2026-03-25 22:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-25 22:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734ddfbc-827b-54de-a383-eec090b57f08 with scrape type 1
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/1.jpg not downloaded yet
2026-03-25 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/2.jpg not downloaded yet
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881b750>
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/4.jpg saved to cache
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28816910>
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/2.jpg saved to cache
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/3.jpg not downloaded yet
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/4.jpg not downloaded yet
2026-03-25 22:49:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c0d10>
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/6.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b4bed0>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/5.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/5.jpg not downloaded yet
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/6.jpg not downloaded yet
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/7.jpg not downloaded yet
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aec690>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/8.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2ac76790>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/7.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669a90>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/9.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/8.jpg not downloaded yet
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/9.jpg not downloaded yet
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361f4d0>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/9.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c10ed0>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/1.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287905d0>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/2.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/10.jpg not downloaded yet
2026-03-25 22:49:19 [ayvens.be] INFO: Found listing with ID: 1982426
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982426%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [ayvens.be] INFO: Scrape type for 1982426: 1
2026-03-25 22:49:19 [ayvens.be] INFO: Extracting data for car ID: 1982426
2026-03-25 22:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-25 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with scrape type 1
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/1.jpg not downloaded yet
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/2.jpg not downloaded yet
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e1f50>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/5.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901efd0>
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F10d0af3b1195420d92f92019d9b9c43e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/10.jpg saved to cache
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322
2026-03-25 22:49:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322, skipping ID generation
2026-03-25 22:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with scrape type 1
2026-03-25 22:49:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 sending to next pipeline
2026-03-25 22:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322, identifier: 1982423
2026-03-25 22:49:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-25 22:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423
2026-03-25 22:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8cacb26c-0ca3-50ba-bd38-cb41d7fd3322 with identifier: 1982423 to the API
2026-03-25 22:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8cacb26c-0ca3-50ba-bd38-cb41d7fd3322',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 43099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cacb26c-0ca3-50ba-bd38-cb41d7fd3322/8cacb26c-0ca3-50ba-bd38-cb41d7fd3322_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/10d0af3b1195420d92f92019d9b9c43e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 CORE',
 'vin': None,
 'year': 2023}
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982423%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [ayvens.be] INFO: Saving data for 1982423: {'created_time': 1774478961.196477, 'last_price_update_time': 1774478961.196486, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982423') HTTP/1.1" 204 0
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/3.jpg not downloaded yet
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/4.jpg not downloaded yet
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6e110>
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/4.jpg saved to cache
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817d50>
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/3.jpg saved to cache
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af490>
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/6.jpg saved to cache
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/5.jpg not downloaded yet
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/6.jpg not downloaded yet
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/7.jpg not downloaded yet
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/8.jpg not downloaded yet
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/9.jpg not downloaded yet
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/10.jpg not downloaded yet
2026-03-25 22:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:21 [ayvens.be] INFO: Found listing with ID: 1982427
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982427%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [ayvens.be] INFO: Scrape type for 1982427: 1
2026-03-25 22:49:21 [ayvens.be] INFO: Extracting data for car ID: 1982427
2026-03-25 22:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-25 22:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006794fd-0d45-53d2-ad92-893dde83a26f with scrape type 1
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/1.jpg not downloaded yet
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28f4e3d0>
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/9.jpg saved to cache
2026-03-25 22:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e0d50>
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/8.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/2.jpg not downloaded yet
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/3.jpg not downloaded yet
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae6810>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/6.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ce2d0>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/1.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236443d0>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/7.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb4790>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/2.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215185d0>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fd439242be625455098e34a6d575f5577%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/10.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b442c974-7063-5b36-a79c-8716b8f0080e
2026-03-25 22:49:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b442c974-7063-5b36-a79c-8716b8f0080e, skipping ID generation
2026-03-25 22:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b442c974-7063-5b36-a79c-8716b8f0080e with scrape type 1
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b442c974-7063-5b36-a79c-8716b8f0080e sending to next pipeline
2026-03-25 22:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b442c974-7063-5b36-a79c-8716b8f0080e, identifier: 1982424
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fce10>
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/3.jpg saved to cache
2026-03-25 22:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-25 22:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424
2026-03-25 22:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b442c974-7063-5b36-a79c-8716b8f0080e with identifier: 1982424 to the API
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b442c974-7063-5b36-a79c-8716b8f0080e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 67110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b442c974-7063-5b36-a79c-8716b8f0080e/b442c974-7063-5b36-a79c-8716b8f0080e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/d439242be625455098e34a6d575f5577/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982424%27 HTTP/1.1" 200 None
2026-03-25 22:49:22 [ayvens.be] INFO: Saving data for 1982424: {'created_time': 1774478962.993294, 'last_price_update_time': 1774478962.993308, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982424') HTTP/1.1" 204 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/4.jpg not downloaded yet
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/5.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/6.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/7.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/8.jpg not downloaded yet
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/9.jpg not downloaded yet
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/10.jpg not downloaded yet
2026-03-25 22:49:23 [ayvens.be] INFO: Found listing with ID: 1982428
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982428%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [ayvens.be] INFO: Scrape type for 1982428: 1
2026-03-25 22:49:23 [ayvens.be] INFO: Extracting data for car ID: 1982428
2026-03-25 22:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-25 22:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7edd12e-9682-5d8d-ab36-625f82b84ab4 with scrape type 1
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/1.jpg not downloaded yet
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c2450>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/5.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/2.jpg not downloaded yet
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a077d0>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/7.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28767590>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/6.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766490>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/2.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28754910>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/1.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/3.jpg not downloaded yet
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/4.jpg not downloaded yet
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28937990>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/4.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a52750>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/8.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a69090>
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/10.jpg saved to cache
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/5.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/6.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/7.jpg not downloaded yet
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/8.jpg not downloaded yet
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/9.jpg not downloaded yet
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/10.jpg not downloaded yet
2026-03-25 22:49:24 [ayvens.be] INFO: Found listing with ID: 1982429
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982429%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [ayvens.be] INFO: Scrape type for 1982429: 1
2026-03-25 22:49:24 [ayvens.be] INFO: Extracting data for car ID: 1982429
2026-03-25 22:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-25 22:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99176e82-1d7f-5fea-8932-0645b25ec15f with scrape type 1
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/1.jpg not downloaded yet
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/2.jpg not downloaded yet
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a50d50>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/4.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28755150>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/1.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23690d10>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/2.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0c110>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/5.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a07cd0>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252F4f0b39d9dc56475487061e8bdfc59794%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/9.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 734ddfbc-827b-54de-a383-eec090b57f08
2026-03-25 22:49:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 734ddfbc-827b-54de-a383-eec090b57f08, skipping ID generation
2026-03-25 22:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734ddfbc-827b-54de-a383-eec090b57f08 with scrape type 1
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 734ddfbc-827b-54de-a383-eec090b57f08 sending to next pipeline
2026-03-25 22:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 734ddfbc-827b-54de-a383-eec090b57f08, identifier: 1982425
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368abd0>
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/6.jpg saved to cache
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/3.jpg not downloaded yet
2026-03-25 22:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-25 22:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425
2026-03-25 22:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 734ddfbc-827b-54de-a383-eec090b57f08 with identifier: 1982425 to the API
2026-03-25 22:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '734ddfbc-827b-54de-a383-eec090b57f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 - 2017',
 'odometer': 140718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 803416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734ddfbc-827b-54de-a383-eec090b57f08/734ddfbc-827b-54de-a383-eec090b57f08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/4f0b39d9dc56475487061e8bdfc59794/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 - 2017 2.0 T6 AWD PHEV Inscription Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Geartronic',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982425%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [ayvens.be] INFO: Saving data for 1982425: {'created_time': 1774478965.156011, 'last_price_update_time': 1774478965.156023, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982425') HTTP/1.1" 204 0
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fe610>
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/7.jpg saved to cache
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd350>
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/3.jpg saved to cache
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/4.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/5.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/6.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/7.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/8.jpg not downloaded yet
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/9.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/10.jpg not downloaded yet
2026-03-25 22:49:25 [ayvens.be] INFO: Found listing with ID: 1982430
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982430%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [ayvens.be] INFO: Scrape type for 1982430: 1
2026-03-25 22:49:25 [ayvens.be] INFO: Extracting data for car ID: 1982430
2026-03-25 22:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-25 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b320123d-41b6-543f-bb50-94cead8a936e with scrape type 1
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/1.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/2.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/3.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/4.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/5.jpg not downloaded yet
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a6d90>
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/4.jpg saved to cache
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/6.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/7.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/8.jpg not downloaded yet
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/9.jpg not downloaded yet
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/10.jpg not downloaded yet
2026-03-25 22:49:25 [ayvens.be] INFO: Found listing with ID: 1982431
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982431%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [ayvens.be] INFO: Scrape type for 1982431: 1
2026-03-25 22:49:25 [ayvens.be] INFO: Extracting data for car ID: 1982431
2026-03-25 22:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-25 22:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d9a820-3a3f-5874-9609-9db0550840c1 with scrape type 1
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/1.jpg not downloaded yet
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/2.jpg not downloaded yet
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/3.jpg not downloaded yet
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21502090>
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/6.jpg saved to cache
2026-03-25 22:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fea90>
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/3.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7d210>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/5.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/4.jpg not downloaded yet
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/5.jpg not downloaded yet
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a6ab90>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/2.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fe290>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/1.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f8290>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/10.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fc810>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/9.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/6.jpg not downloaded yet
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/7.jpg not downloaded yet
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23d50>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/4.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/8.jpg not downloaded yet
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/9.jpg not downloaded yet
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/10.jpg not downloaded yet
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42e90>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/5.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23850>
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/6.jpg saved to cache
2026-03-25 22:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:26 [ayvens.be] INFO: Found listing with ID: 1982432
2026-03-25 22:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982432%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [ayvens.be] INFO: Scrape type for 1982432: 1
2026-03-25 22:49:27 [ayvens.be] INFO: Extracting data for car ID: 1982432
2026-03-25 22:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-25 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with scrape type 1
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/1.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/2.jpg not downloaded yet
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150f710>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/9.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c8290>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/3.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7110>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/10.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ed50>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/2.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766ad0>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/3.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876cd90>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/7.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/3.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/4.jpg not downloaded yet
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/5.jpg not downloaded yet
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/6.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/7.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/8.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/9.jpg not downloaded yet
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/10.jpg not downloaded yet
2026-03-25 22:49:27 [ayvens.be] INFO: Found listing with ID: 1982433
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982433%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [ayvens.be] INFO: Scrape type for 1982433: 1
2026-03-25 22:49:27 [ayvens.be] INFO: Extracting data for car ID: 1982433
2026-03-25 22:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-25 22:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3a3245-cd3c-575e-bc30-7574e9b71011 with scrape type 1
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/1.jpg not downloaded yet
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a94190>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/6.jpg saved to cache
2026-03-25 22:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28793750>
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/4.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/2.jpg not downloaded yet
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa08d0>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/5.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c12350>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/7.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503310>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/10.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aed190>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/8.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99a90>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/9.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a7b50>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/4.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/3.jpg not downloaded yet
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/4.jpg not downloaded yet
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bd6d0>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/5.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/5.jpg not downloaded yet
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/6.jpg not downloaded yet
2026-03-25 22:49:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884a2d0>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/3.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a223d0>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/8.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5e890>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/6.jpg saved to cache
2026-03-25 22:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28825d50>
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/7.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/7.jpg not downloaded yet
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/8.jpg not downloaded yet
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/9.jpg not downloaded yet
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7f50>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/2.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac71d0>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/1.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848d10>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/3.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/10.jpg not downloaded yet
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [ayvens.be] INFO: Found listing with ID: 1982434
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982434%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [ayvens.be] INFO: Scrape type for 1982434: 1
2026-03-25 22:49:29 [ayvens.be] INFO: Extracting data for car ID: 1982434
2026-03-25 22:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-25 22:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70b48f7-8da6-5910-aa96-0829617f29de with scrape type 1
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/1.jpg not downloaded yet
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bca2d0>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/3.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28756590>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/10.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/2.jpg not downloaded yet
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/3.jpg not downloaded yet
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/4.jpg not downloaded yet
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876c590>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/4.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ff10>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/2.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fec10>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/2.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa4150>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/1.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892e750>
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/1.jpg saved to cache
2026-03-25 22:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/5.jpg not downloaded yet
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/6.jpg not downloaded yet
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fb790>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/10.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2c150>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/6.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/7.jpg not downloaded yet
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/8.jpg not downloaded yet
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/9.jpg not downloaded yet
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28848dd0>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/9.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a849a90>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/8.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f2d0>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/3.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d5950>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/7.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/10.jpg not downloaded yet
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [ayvens.be] INFO: Found listing with ID: 1982435
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982435%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [ayvens.be] INFO: Scrape type for 1982435: 1
2026-03-25 22:49:30 [ayvens.be] INFO: Extracting data for car ID: 1982435
2026-03-25 22:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-25 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89c3738-2d1b-5d36-ab42-4308943fc454 with scrape type 1
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/1.jpg not downloaded yet
2026-03-25 22:49:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21518990>
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fc93353f1845348bf86e7abedbb98a16e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/5.jpg saved to cache
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c
2026-03-25 22:49:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c, skipping ID generation
2026-03-25 22:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with scrape type 1
2026-03-25 22:49:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae9b7317-3666-5793-8bd7-fc93e9fb3c3c sending to next pipeline
2026-03-25 22:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c, identifier: 1982432
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23656910>
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/5.jpg saved to cache
2026-03-25 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b3805cc50>
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/4.jpg saved to cache
2026-03-25 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/2.jpg not downloaded yet
2026-03-25 22:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-25 22:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432
2026-03-25 22:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ae9b7317-3666-5793-8bd7-fc93e9fb3c3c with identifier: 1982432 to the API
2026-03-25 22:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ae9b7317-3666-5793-8bd7-fc93e9fb3c3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 60189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae9b7317-3666-5793-8bd7-fc93e9fb3c3c/ae9b7317-3666-5793-8bd7-fc93e9fb3c3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/c93353f1845348bf86e7abedbb98a16e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI Move! DSG (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.0 TSI Move! DSG (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982432%27 HTTP/1.1" 200 None
2026-03-25 22:49:32 [ayvens.be] INFO: Saving data for 1982432: {'created_time': 1774478972.748628, 'last_price_update_time': 1774478972.748639, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982432') HTTP/1.1" 204 0
2026-03-25 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/3.jpg not downloaded yet
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/4.jpg not downloaded yet
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c1210>
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/8.jpg saved to cache
2026-03-25 22:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d7c90>
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/9.jpg saved to cache
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2c7d0>
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/7.jpg saved to cache
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/5.jpg not downloaded yet
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287774d0>
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F0b66292063424fb39bbb3ce55c719e11%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/9.jpg saved to cache
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1d9a820-3a3f-5874-9609-9db0550840c1
2026-03-25 22:49:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1d9a820-3a3f-5874-9609-9db0550840c1, skipping ID generation
2026-03-25 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d9a820-3a3f-5874-9609-9db0550840c1 with scrape type 1
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1d9a820-3a3f-5874-9609-9db0550840c1 sending to next pipeline
2026-03-25 22:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1d9a820-3a3f-5874-9609-9db0550840c1, identifier: 1982431
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151b250>
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/6.jpg saved to cache
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-25 22:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431
2026-03-25 22:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1d9a820-3a3f-5874-9609-9db0550840c1 with identifier: 1982431 to the API
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd1d9a820-3a3f-5874-9609-9db0550840c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 30433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d9a820-3a3f-5874-9609-9db0550840c1/d1d9a820-3a3f-5874-9609-9db0550840c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/0b66292063424fb39bbb3ce55c719e11/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.3 TCE MHEV 140 R.S. LINE EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE MHEV 140 R.S. LINE EDC',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982431%27 HTTP/1.1" 200 None
2026-03-25 22:49:33 [ayvens.be] INFO: Saving data for 1982431: {'created_time': 1774478973.814668, 'last_price_update_time': 1774478973.814677, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982431') HTTP/1.1" 204 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/6.jpg not downloaded yet
2026-03-25 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5cd50>
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fe50cac5038f141898d0742f7b8598b0e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/10.jpg saved to cache
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c3a3245-cd3c-575e-bc30-7574e9b71011
2026-03-25 22:49:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c3a3245-cd3c-575e-bc30-7574e9b71011, skipping ID generation
2026-03-25 22:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3a3245-cd3c-575e-bc30-7574e9b71011 with scrape type 1
2026-03-25 22:49:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c3a3245-cd3c-575e-bc30-7574e9b71011 sending to next pipeline
2026-03-25 22:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c3a3245-cd3c-575e-bc30-7574e9b71011, identifier: 1982433
2026-03-25 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/7.jpg not downloaded yet
2026-03-25 22:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-25 22:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433
2026-03-25 22:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7c3a3245-cd3c-575e-bc30-7574e9b71011 with identifier: 1982433 to the API
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7c3a3245-cd3c-575e-bc30-7574e9b71011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 57430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3a3245-cd3c-575e-bc30-7574e9b71011/7c3a3245-cd3c-575e-bc30-7574e9b71011_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/e50cac5038f141898d0742f7b8598b0e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982433%27 HTTP/1.1" 200 None
2026-03-25 22:49:34 [ayvens.be] INFO: Saving data for 1982433: {'created_time': 1774478974.417576, 'last_price_update_time': 1774478974.417586, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982433') HTTP/1.1" 204 0
2026-03-25 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/8.jpg not downloaded yet
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a69ad0>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/2.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bcbbd0>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/3.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742250>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/4.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287640d0>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/2.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21501c10>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/1.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/9.jpg not downloaded yet
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/10.jpg not downloaded yet
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b48610>
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/5.jpg saved to cache
2026-03-25 22:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:34 [ayvens.be] INFO: Found listing with ID: 1982436
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982436%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [ayvens.be] INFO: Scrape type for 1982436: 1
2026-03-25 22:49:35 [ayvens.be] INFO: Extracting data for car ID: 1982436
2026-03-25 22:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-25 22:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f4aa23-fa08-539a-9861-8e6329050ac7 with scrape type 1
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/1.jpg not downloaded yet
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/2.jpg not downloaded yet
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b49ed0>
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F7d297bd2f4bb4f31a3058519c3c4cab5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/1.jpg saved to cache
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b320123d-41b6-543f-bb50-94cead8a936e
2026-03-25 22:49:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b320123d-41b6-543f-bb50-94cead8a936e, skipping ID generation
2026-03-25 22:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b320123d-41b6-543f-bb50-94cead8a936e with scrape type 1
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b320123d-41b6-543f-bb50-94cead8a936e sending to next pipeline
2026-03-25 22:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b320123d-41b6-543f-bb50-94cead8a936e, identifier: 1982430
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/3.jpg not downloaded yet
2026-03-25 22:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-25 22:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430
2026-03-25 22:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b320123d-41b6-543f-bb50-94cead8a936e with identifier: 1982430 to the API
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'b320123d-41b6-543f-bb50-94cead8a936e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'ENYAQ',
 'odometer': 52903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b320123d-41b6-543f-bb50-94cead8a936e/b320123d-41b6-543f-bb50-94cead8a936e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/7d297bd2f4bb4f31a3058519c3c4cab5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA ENYAQ 62KWH IV 60',
 'transmission': 'automatic',
 'trim': '62KWH IV 60',
 'vin': None,
 'year': 2023}
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982430%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [ayvens.be] INFO: Saving data for 1982430: {'created_time': 1774478975.697299, 'last_price_update_time': 1774478975.697308, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982430') HTTP/1.1" 204 0
2026-03-25 22:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/4.jpg not downloaded yet
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc4950>
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/8.jpg saved to cache
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21509050>
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/10.jpg saved to cache
2026-03-25 22:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880bf90>
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/6.jpg saved to cache
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289378d0>
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/7.jpg saved to cache
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d8f10>
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/9.jpg saved to cache
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc47d0>
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/9.jpg saved to cache
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/5.jpg not downloaded yet
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/6.jpg not downloaded yet
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809a10>
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fed50fc7205a9431ea7095e225523dfe2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/10.jpg saved to cache
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e70b48f7-8da6-5910-aa96-0829617f29de
2026-03-25 22:49:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e70b48f7-8da6-5910-aa96-0829617f29de, skipping ID generation
2026-03-25 22:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70b48f7-8da6-5910-aa96-0829617f29de with scrape type 1
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e70b48f7-8da6-5910-aa96-0829617f29de sending to next pipeline
2026-03-25 22:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70b48f7-8da6-5910-aa96-0829617f29de, identifier: 1982434
2026-03-25 22:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-25 22:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434
2026-03-25 22:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70b48f7-8da6-5910-aa96-0829617f29de with identifier: 1982434 to the API
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e70b48f7-8da6-5910-aa96-0829617f29de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 64633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e70b48f7-8da6-5910-aa96-0829617f29de/e70b48f7-8da6-5910-aa96-0829617f29de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/ed50fc7205a9431ea7095e225523dfe2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982434%27 HTTP/1.1" 200 None
2026-03-25 22:49:36 [ayvens.be] INFO: Saving data for 1982434: {'created_time': 1774478976.859149, 'last_price_update_time': 1774478976.859159, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982434') HTTP/1.1" 204 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/7.jpg not downloaded yet
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/8.jpg not downloaded yet
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a638290>
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/1.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/9.jpg not downloaded yet
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/10.jpg not downloaded yet
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d9ad0>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/4.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb5a90>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/8.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:37 [ayvens.be] INFO: Found listing with ID: 1982437
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982437%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [ayvens.be] INFO: Scrape type for 1982437: 1
2026-03-25 22:49:37 [ayvens.be] INFO: Extracting data for car ID: 1982437
2026-03-25 22:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-25 22:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f89d208-018d-551e-9200-7252e06ab89e with scrape type 1
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/1.jpg not downloaded yet
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28798f10>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/3.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ca890>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/2.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7cd50>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/5.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/2.jpg not downloaded yet
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cc9d0>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/6.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b79d0>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/7.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/3.jpg not downloaded yet
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/4.jpg not downloaded yet
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/5.jpg not downloaded yet
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/6.jpg not downloaded yet
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/7.jpg not downloaded yet
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/8.jpg not downloaded yet
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/9.jpg not downloaded yet
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eba10>
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/6.jpg saved to cache
2026-03-25 22:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/10.jpg not downloaded yet
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4d50>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/8.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a6a310>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/5.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:38 [ayvens.be] INFO: Found listing with ID: 1982438
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982438%27 HTTP/1.1" 200 None
2026-03-25 22:49:38 [ayvens.be] INFO: Scrape type for 1982438: 1
2026-03-25 22:49:38 [ayvens.be] INFO: Extracting data for car ID: 1982438
2026-03-25 22:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-25 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with scrape type 1
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/1.jpg not downloaded yet
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/2.jpg not downloaded yet
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b7590>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/1.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289345d0>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/4.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b5690>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/9.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890dbd0>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F01b9ffdfa11346f1889ed6cfbefb11d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/10.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f89c3738-2d1b-5d36-ab42-4308943fc454
2026-03-25 22:49:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f89c3738-2d1b-5d36-ab42-4308943fc454, skipping ID generation
2026-03-25 22:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89c3738-2d1b-5d36-ab42-4308943fc454 with scrape type 1
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f89c3738-2d1b-5d36-ab42-4308943fc454 sending to next pipeline
2026-03-25 22:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f89c3738-2d1b-5d36-ab42-4308943fc454, identifier: 1982435
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2ab778d0>
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/2.jpg saved to cache
2026-03-25 22:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-25 22:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435
2026-03-25 22:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f89c3738-2d1b-5d36-ab42-4308943fc454 with identifier: 1982435 to the API
2026-03-25 22:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f89c3738-2d1b-5d36-ab42-4308943fc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 48115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89c3738-2d1b-5d36-ab42-4308943fc454/f89c3738-2d1b-5d36-ab42-4308943fc454_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 881308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/01b9ffdfa11346f1889ed6cfbefb11d0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 1.0 TCE 100 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 100 CORPORATE EDITION',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982435%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [ayvens.be] INFO: Saving data for 1982435: {'created_time': 1774478979.221198, 'last_price_update_time': 1774478979.221207, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982435') HTTP/1.1" 204 0
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/3.jpg not downloaded yet
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/4.jpg not downloaded yet
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/5.jpg not downloaded yet
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/6.jpg not downloaded yet
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/7.jpg not downloaded yet
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/8.jpg not downloaded yet
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/9.jpg not downloaded yet
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/10.jpg not downloaded yet
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aecd10>
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/5.jpg saved to cache
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:39 [ayvens.be] INFO: Found listing with ID: 1982439
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982439%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [ayvens.be] INFO: Scrape type for 1982439: 1
2026-03-25 22:49:39 [ayvens.be] INFO: Extracting data for car ID: 1982439
2026-03-25 22:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-25 22:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11297d7e-0041-5c3f-8223-1d581758c2af with scrape type 1
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/1.jpg not downloaded yet
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aece50>
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/3.jpg saved to cache
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a4c90>
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/9.jpg saved to cache
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23625d10>
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F6db26ec55e694e459264e8e0c9e0a35f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/1.jpg saved to cache
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99176e82-1d7f-5fea-8932-0645b25ec15f
2026-03-25 22:49:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99176e82-1d7f-5fea-8932-0645b25ec15f, skipping ID generation
2026-03-25 22:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99176e82-1d7f-5fea-8932-0645b25ec15f with scrape type 1
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99176e82-1d7f-5fea-8932-0645b25ec15f sending to next pipeline
2026-03-25 22:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99176e82-1d7f-5fea-8932-0645b25ec15f, identifier: 1982429
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/2.jpg not downloaded yet
2026-03-25 22:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-25 22:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429
2026-03-25 22:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99176e82-1d7f-5fea-8932-0645b25ec15f with identifier: 1982429 to the API
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '99176e82-1d7f-5fea-8932-0645b25ec15f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99176e82-1d7f-5fea-8932-0645b25ec15f/99176e82-1d7f-5fea-8932-0645b25ec15f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/6db26ec55e694e459264e8e0c9e0a35f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW MOVE',
 'vin': None,
 'year': 2023}
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982429%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [ayvens.be] INFO: Saving data for 1982429: {'created_time': 1774478980.424613, 'last_price_update_time': 1774478980.424623, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982429') HTTP/1.1" 204 0
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/3.jpg not downloaded yet
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6c110>
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/7.jpg saved to cache
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879be50>
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/4.jpg saved to cache
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742850>
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/8.jpg saved to cache
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874a190>
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/6.jpg saved to cache
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/4.jpg not downloaded yet
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/5.jpg not downloaded yet
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/6.jpg not downloaded yet
2026-03-25 22:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/7.jpg not downloaded yet
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/8.jpg not downloaded yet
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/9.jpg not downloaded yet
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4f5d0>
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/2.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8690>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/1.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42a90>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/5.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/10.jpg not downloaded yet
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361d790>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/3.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b4a750>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/4.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288279d0>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/10.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64c690>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/9.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:41 [ayvens.be] INFO: Found listing with ID: 1982440
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982440%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [ayvens.be] INFO: Scrape type for 1982440: 1
2026-03-25 22:49:41 [ayvens.be] INFO: Extracting data for car ID: 1982440
2026-03-25 22:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-25 22:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dae2d0-e29a-59df-8608-9073adf888ee with scrape type 1
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/1.jpg not downloaded yet
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236488d0>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/1.jpg saved to cache
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/2.jpg not downloaded yet
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/3.jpg not downloaded yet
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/4.jpg not downloaded yet
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/5.jpg not downloaded yet
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/6.jpg not downloaded yet
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/7.jpg not downloaded yet
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/8.jpg not downloaded yet
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b14d0>
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/3.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/9.jpg not downloaded yet
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368c6d0>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/8.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/10.jpg not downloaded yet
2026-03-25 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:42 [ayvens.be] INFO: Found listing with ID: 1982441
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982441%27 HTTP/1.1" 200 None
2026-03-25 22:49:42 [ayvens.be] INFO: Scrape type for 1982441: 1
2026-03-25 22:49:42 [ayvens.be] INFO: Extracting data for car ID: 1982441
2026-03-25 22:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-25 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744b5375-f1be-5813-9a5a-21ba7d244bb9 with scrape type 1
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/1.jpg not downloaded yet
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28907d10>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/10.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b5350>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/7.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4250>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ne%252Ff2845d4f76af42569fc9cdc1bbeb53bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/6.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f89d208-018d-551e-9200-7252e06ab89e
2026-03-25 22:49:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f89d208-018d-551e-9200-7252e06ab89e, skipping ID generation
2026-03-25 22:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f89d208-018d-551e-9200-7252e06ab89e with scrape type 1
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f89d208-018d-551e-9200-7252e06ab89e sending to next pipeline
2026-03-25 22:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f89d208-018d-551e-9200-7252e06ab89e, identifier: 1982437
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e7d0>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/1.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd990>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/4.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23602690>
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/2.jpg saved to cache
2026-03-25 22:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-25 22:49:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437
2026-03-25 22:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f89d208-018d-551e-9200-7252e06ab89e with identifier: 1982437 to the API
2026-03-25 22:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'BLANC GLACIER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9f89d208-018d-551e-9200-7252e06ab89e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON MWB DSL - 20',
 'odometer': 93512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538533,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f89d208-018d-551e-9200-7252e06ab89e/9f89d208-018d-551e-9200-7252e06ab89e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ne/f2845d4f76af42569fc9cdc1bbeb53bb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-05',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON MWB DSL - 20 1.6 dCi 29 L2H1 Energy '
          'Tw.Turbo Gd Conf.   STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L2H1 Energy Tw.Turbo Gd Conf.   STOCK',
 'vin': None,
 'year': 2016}
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982437%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [ayvens.be] INFO: Saving data for 1982437: {'created_time': 1774478983.242525, 'last_price_update_time': 1774478983.242535, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982437') HTTP/1.1" 204 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/2.jpg not downloaded yet
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/3.jpg not downloaded yet
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874acd0>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/9.jpg saved to cache
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236688d0>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/8.jpg saved to cache
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21500dd0>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/6.jpg saved to cache
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/4.jpg not downloaded yet
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/5.jpg not downloaded yet
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21510490>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/2.jpg saved to cache
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688d50>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/7.jpg saved to cache
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/6.jpg not downloaded yet
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/7.jpg not downloaded yet
2026-03-25 22:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874ab90>
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/3.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a72b0d0>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/4.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236dbc10>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/5.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/8.jpg not downloaded yet
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/9.jpg not downloaded yet
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/10.jpg not downloaded yet
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236dbe50>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/2.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21523550>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/1.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7d950>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/10.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [ayvens.be] INFO: Found listing with ID: 1982442
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982442%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [ayvens.be] INFO: Scrape type for 1982442: 1
2026-03-25 22:49:44 [ayvens.be] INFO: Extracting data for car ID: 1982442
2026-03-25 22:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-25 22:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with scrape type 1
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/1.jpg not downloaded yet
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/2.jpg not downloaded yet
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ea50>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/9.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/3.jpg not downloaded yet
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/4.jpg not downloaded yet
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/5.jpg not downloaded yet
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289f9090>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/3.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28740110>
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/10.jpg saved to cache
2026-03-25 22:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/6.jpg not downloaded yet
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/7.jpg not downloaded yet
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f350>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/7.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28757750>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/4.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ea310>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/8.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809a50>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/9.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e9450>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/1.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/8.jpg not downloaded yet
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/9.jpg not downloaded yet
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/10.jpg not downloaded yet
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a363ad0>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/8.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [ayvens.be] INFO: Found listing with ID: 1982443
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982443%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [ayvens.be] INFO: Scrape type for 1982443: 1
2026-03-25 22:49:45 [ayvens.be] INFO: Extracting data for car ID: 1982443
2026-03-25 22:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-25 22:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacad840-061c-5dfe-87e8-f7489674923f with scrape type 1
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/1.jpg not downloaded yet
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/2.jpg not downloaded yet
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c12fd0>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/4.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b6710>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/3.jpg saved to cache
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/3.jpg not downloaded yet
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/4.jpg not downloaded yet
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28764110>
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/5.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ff990>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/2.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f0c50>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/7.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b7a50>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/6.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/5.jpg not downloaded yet
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/6.jpg not downloaded yet
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa4410>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/6.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288eba90>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/8.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/7.jpg not downloaded yet
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/8.jpg not downloaded yet
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/9.jpg not downloaded yet
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/10.jpg not downloaded yet
2026-03-25 22:49:46 [ayvens.be] INFO: Found listing with ID: 1982444
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982444%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [ayvens.be] INFO: Scrape type for 1982444: 1
2026-03-25 22:49:46 [ayvens.be] INFO: Extracting data for car ID: 1982444
2026-03-25 22:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-25 22:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8131033-29d9-5848-adc6-3c6d85d7287d with scrape type 1
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/1.jpg not downloaded yet
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/2.jpg not downloaded yet
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23603c50>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/1.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8110>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/2.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/3.jpg not downloaded yet
2026-03-25 22:49:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/4.jpg not downloaded yet
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892fed0>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/9.jpg saved to cache
2026-03-25 22:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288481d0>
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/7.jpg saved to cache
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28743890>
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252F1c6ea3fc462b4c3b804a5e9e6e79c535%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/10.jpg saved to cache
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 744b5375-f1be-5813-9a5a-21ba7d244bb9
2026-03-25 22:49:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 744b5375-f1be-5813-9a5a-21ba7d244bb9, skipping ID generation
2026-03-25 22:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744b5375-f1be-5813-9a5a-21ba7d244bb9 with scrape type 1
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 744b5375-f1be-5813-9a5a-21ba7d244bb9 sending to next pipeline
2026-03-25 22:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 744b5375-f1be-5813-9a5a-21ba7d244bb9, identifier: 1982441
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff6790>
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/4.jpg saved to cache
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0d0d0>
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/3.jpg saved to cache
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc5cd0>
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/5.jpg saved to cache
2026-03-25 22:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-25 22:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441
2026-03-25 22:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 744b5375-f1be-5813-9a5a-21ba7d244bb9 with identifier: 1982441 to the API
2026-03-25 22:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '744b5375-f1be-5813-9a5a-21ba7d244bb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 113085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744b5375-f1be-5813-9a5a-21ba7d244bb9/744b5375-f1be-5813-9a5a-21ba7d244bb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/1c6ea3fc462b4c3b804a5e9e6e79c535/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982441%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [ayvens.be] INFO: Saving data for 1982441: {'created_time': 1774478988.129205, 'last_price_update_time': 1774478988.129216, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982441') HTTP/1.1" 204 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/5.jpg not downloaded yet
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/6.jpg not downloaded yet
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fea310>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/10.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/7.jpg not downloaded yet
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/8.jpg not downloaded yet
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/9.jpg not downloaded yet
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42690>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/9.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/10.jpg not downloaded yet
2026-03-25 22:49:48 [ayvens.be] INFO: Found listing with ID: 1982445
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982445%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [ayvens.be] INFO: Scrape type for 1982445: 1
2026-03-25 22:49:48 [ayvens.be] INFO: Extracting data for car ID: 1982445
2026-03-25 22:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-25 22:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e269c9ed-ab32-5654-928d-86dbafcc8c10 with scrape type 1
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/1.jpg not downloaded yet
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/2.jpg not downloaded yet
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c0f50>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/8.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668310>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/6.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23657850>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/1.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878b1d0>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F7465844ffd5046a3929d34c51c1ddc0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/7.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5
2026-03-25 22:49:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9f907ef-5d82-5033-af2e-bd0a3e4569b5, skipping ID generation
2026-03-25 22:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with scrape type 1
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9f907ef-5d82-5033-af2e-bd0a3e4569b5 sending to next pipeline
2026-03-25 22:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f9f907ef-5d82-5033-af2e-bd0a3e4569b5, identifier: 1982442
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac6cd0>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/3.jpg saved to cache
2026-03-25 22:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c1310>
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/2.jpg saved to cache
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283ab190>
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/6.jpg saved to cache
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-25 22:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442
2026-03-25 22:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f9f907ef-5d82-5033-af2e-bd0a3e4569b5 with identifier: 1982442 to the API
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f9f907ef-5d82-5033-af2e-bd0a3e4569b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V90 CROSS COUNTRY',
 'odometer': 113361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f907ef-5d82-5033-af2e-bd0a3e4569b5/f9f907ef-5d82-5033-af2e-bd0a3e4569b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/7465844ffd5046a3929d34c51c1ddc0c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V90 CROSS COUNTRY 2.0 B4 D 4WD GEARTR. CROSS COUNTRY PRO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D 4WD GEARTR. CROSS COUNTRY PRO',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982442%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [ayvens.be] INFO: Saving data for 1982442: {'created_time': 1774478989.504201, 'last_price_update_time': 1774478989.504212, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982442') HTTP/1.1" 204 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/3.jpg not downloaded yet
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/4.jpg not downloaded yet
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/5.jpg not downloaded yet
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/6.jpg not downloaded yet
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/7.jpg not downloaded yet
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/8.jpg not downloaded yet
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/9.jpg not downloaded yet
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/10.jpg not downloaded yet
2026-03-25 22:49:49 [ayvens.be] INFO: Found listing with ID: 1982446
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982446%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [ayvens.be] INFO: Scrape type for 1982446: 1
2026-03-25 22:49:49 [ayvens.be] INFO: Extracting data for car ID: 1982446
2026-03-25 22:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-25 22:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with scrape type 1
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/1.jpg not downloaded yet
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac7e10>
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/10.jpg saved to cache
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b7a50>
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/9.jpg saved to cache
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0fd10>
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/7.jpg saved to cache
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/2.jpg not downloaded yet
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eddd0>
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/8.jpg saved to cache
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6dd50>
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/5.jpg saved to cache
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/3.jpg not downloaded yet
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/4.jpg not downloaded yet
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6d050>
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252Fe85f032d1d944ca9b9140ccf30e6d95f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/4.jpg saved to cache
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cacad840-061c-5dfe-87e8-f7489674923f
2026-03-25 22:49:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cacad840-061c-5dfe-87e8-f7489674923f, skipping ID generation
2026-03-25 22:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacad840-061c-5dfe-87e8-f7489674923f with scrape type 1
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cacad840-061c-5dfe-87e8-f7489674923f sending to next pipeline
2026-03-25 22:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cacad840-061c-5dfe-87e8-f7489674923f, identifier: 1982443
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28826e10>
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/2.jpg saved to cache
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64b890>
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/3.jpg saved to cache
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-25 22:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443
2026-03-25 22:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cacad840-061c-5dfe-87e8-f7489674923f with identifier: 1982443 to the API
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cacad840-061c-5dfe-87e8-f7489674923f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cacad840-061c-5dfe-87e8-f7489674923f/cacad840-061c-5dfe-87e8-f7489674923f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/e85f032d1d944ca9b9140ccf30e6d95f/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I (100KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982443%27 HTTP/1.1" 200 None
2026-03-25 22:49:50 [ayvens.be] INFO: Saving data for 1982443: {'created_time': 1774478990.919816, 'last_price_update_time': 1774478990.919826, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982443') HTTP/1.1" 204 0
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/5.jpg not downloaded yet
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/6.jpg not downloaded yet
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/7.jpg not downloaded yet
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/8.jpg not downloaded yet
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/9.jpg not downloaded yet
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/10.jpg not downloaded yet
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28765910>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/5.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [ayvens.be] INFO: Found listing with ID: 1982447
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982447%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [ayvens.be] INFO: Scrape type for 1982447: 1
2026-03-25 22:49:51 [ayvens.be] INFO: Extracting data for car ID: 1982447
2026-03-25 22:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-25 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5178048-2c9e-57b9-b033-270f599fcfcb with scrape type 1
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/1.jpg not downloaded yet
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aec950>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/1.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/2.jpg not downloaded yet
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/3.jpg not downloaded yet
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23690290>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/10.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23610dd0>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/9.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688290>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F0ba5ba426d3a4bf99c5698a18cd0cd51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/5.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13dae2d0-e29a-59df-8608-9073adf888ee
2026-03-25 22:49:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13dae2d0-e29a-59df-8608-9073adf888ee, skipping ID generation
2026-03-25 22:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dae2d0-e29a-59df-8608-9073adf888ee with scrape type 1
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13dae2d0-e29a-59df-8608-9073adf888ee sending to next pipeline
2026-03-25 22:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13dae2d0-e29a-59df-8608-9073adf888ee, identifier: 1982440
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2cb90>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/7.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b48e10>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/6.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8750>
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/4.jpg saved to cache
2026-03-25 22:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-25 22:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440
2026-03-25 22:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13dae2d0-e29a-59df-8608-9073adf888ee with identifier: 1982440 to the API
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '13dae2d0-e29a-59df-8608-9073adf888ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 110738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dae2d0-e29a-59df-8608-9073adf888ee/13dae2d0-e29a-59df-8608-9073adf888ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/0ba5ba426d3a4bf99c5698a18cd0cd51/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Sportline II',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Sportline II',
 'vin': None,
 'year': 2020}
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982440%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [ayvens.be] INFO: Saving data for 1982440: {'created_time': 1774478992.274762, 'last_price_update_time': 1774478992.274772, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982440') HTTP/1.1" 204 0
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/4.jpg not downloaded yet
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/5.jpg not downloaded yet
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/6.jpg not downloaded yet
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/7.jpg not downloaded yet
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/8.jpg not downloaded yet
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/9.jpg not downloaded yet
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/10.jpg not downloaded yet
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42190>
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/4.jpg saved to cache
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:52 [ayvens.be] INFO: Found listing with ID: 1982448
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982448%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [ayvens.be] INFO: Scrape type for 1982448: 1
2026-03-25 22:49:52 [ayvens.be] INFO: Extracting data for car ID: 1982448
2026-03-25 22:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-25 22:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46150241-ab67-52a9-bf8f-5fecb2aa1682 with scrape type 1
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/1.jpg not downloaded yet
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42950>
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/1.jpg saved to cache
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/2.jpg not downloaded yet
2026-03-25 22:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/3.jpg not downloaded yet
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23646bd0>
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F2d0fc708760449ab8afc823e90bdd5b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/8.jpg saved to cache
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8131033-29d9-5848-adc6-3c6d85d7287d
2026-03-25 22:49:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8131033-29d9-5848-adc6-3c6d85d7287d, skipping ID generation
2026-03-25 22:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8131033-29d9-5848-adc6-3c6d85d7287d with scrape type 1
2026-03-25 22:49:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8131033-29d9-5848-adc6-3c6d85d7287d sending to next pipeline
2026-03-25 22:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8131033-29d9-5848-adc6-3c6d85d7287d, identifier: 1982444
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366a990>
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/3.jpg saved to cache
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ccd0>
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/2.jpg saved to cache
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7950>
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/5.jpg saved to cache
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd910>
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252Fcdb1fe50c85446d3ba705dfb1327e328%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/6.jpg saved to cache
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11297d7e-0041-5c3f-8223-1d581758c2af
2026-03-25 22:49:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11297d7e-0041-5c3f-8223-1d581758c2af, skipping ID generation
2026-03-25 22:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11297d7e-0041-5c3f-8223-1d581758c2af with scrape type 1
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11297d7e-0041-5c3f-8223-1d581758c2af sending to next pipeline
2026-03-25 22:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 11297d7e-0041-5c3f-8223-1d581758c2af, identifier: 1982439
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749690>
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/6.jpg saved to cache
2026-03-25 22:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-25 22:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444
2026-03-25 22:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8131033-29d9-5848-adc6-3c6d85d7287d with identifier: 1982444 to the API
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f8131033-29d9-5848-adc6-3c6d85d7287d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 86531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632508,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8131033-29d9-5848-adc6-3c6d85d7287d/f8131033-29d9-5848-adc6-3c6d85d7287d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/2d0fc708760449ab8afc823e90bdd5b2/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982444%27 HTTP/1.1" 200 None
2026-03-25 22:49:53 [ayvens.be] INFO: Saving data for 1982444: {'created_time': 1774478993.858937, 'last_price_update_time': 1774478993.858946, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982444') HTTP/1.1" 204 0
2026-03-25 22:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-25 22:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439
2026-03-25 22:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 11297d7e-0041-5c3f-8223-1d581758c2af with identifier: 1982439 to the API
2026-03-25 22:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '11297d7e-0041-5c3f-8223-1d581758c2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORTS',
 'odometer': 117699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11297d7e-0041-5c3f-8223-1d581758c2af/11297d7e-0041-5c3f-8223-1d581758c2af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/cdb1fe50c85446d3ba705dfb1327e328/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA TOURING SPORTS 1.8 HEV DYNAMIC E-CVT',
 'transmission': 'automatic',
 'trim': '1.8 HEV DYNAMIC E-CVT',
 'vin': None,
 'year': 2022}
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982439%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [ayvens.be] INFO: Saving data for 1982439: {'created_time': 1774478994.212064, 'last_price_update_time': 1774478994.212073, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982439') HTTP/1.1" 204 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/4.jpg not downloaded yet
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/5.jpg not downloaded yet
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a53b7d0>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/4.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/6.jpg not downloaded yet
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/7.jpg not downloaded yet
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/8.jpg not downloaded yet
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1c590>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/1.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0d850>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/3.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f1050>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/5.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc47d0>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/2.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/9.jpg not downloaded yet
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c10950>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/1.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/10.jpg not downloaded yet
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236afa50>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/3.jpg saved to cache
2026-03-25 22:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236cac90>
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/10.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28757a50>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/9.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [ayvens.be] INFO: Found listing with ID: 1982449
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982449%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [ayvens.be] INFO: Scrape type for 1982449: 1
2026-03-25 22:49:55 [ayvens.be] INFO: Extracting data for car ID: 1982449
2026-03-25 22:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-25 22:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124521f8-a17b-51a0-b34b-df47fd238977 with scrape type 1
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/1.jpg not downloaded yet
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/2.jpg not downloaded yet
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b789d0>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/4.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/3.jpg not downloaded yet
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/4.jpg not downloaded yet
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878a3d0>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/6.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876e590>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/5.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236acd50>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/2.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/5.jpg not downloaded yet
2026-03-25 22:49:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/6.jpg not downloaded yet
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/7.jpg not downloaded yet
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a21a10>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/10.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236936d0>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/9.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9810>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/7.jpg saved to cache
2026-03-25 22:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ee50>
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/2.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/8.jpg not downloaded yet
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/9.jpg not downloaded yet
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21527750>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/3.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/10.jpg not downloaded yet
2026-03-25 22:49:56 [ayvens.be] INFO: Found listing with ID: 1982450
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982450%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [ayvens.be] INFO: Scrape type for 1982450: 1
2026-03-25 22:49:56 [ayvens.be] INFO: Extracting data for car ID: 1982450
2026-03-25 22:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-25 22:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d457ea5-817c-5892-85d4-161dbe8956cc with scrape type 1
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/1.jpg not downloaded yet
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/2.jpg not downloaded yet
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151b1d0>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/4.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c9bd0>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/9.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/3.jpg not downloaded yet
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/4.jpg not downloaded yet
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b79f50>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/1.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368b2d0>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/10.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ba290>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/5.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150e210>
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/6.jpg saved to cache
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/5.jpg not downloaded yet
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/6.jpg not downloaded yet
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/7.jpg not downloaded yet
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28907450>
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/7.jpg saved to cache
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236419d0>
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/8.jpg saved to cache
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/8.jpg not downloaded yet
2026-03-25 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/9.jpg not downloaded yet
2026-03-25 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28755cd0>
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/1.jpg saved to cache
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288fcdd0>
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/10.jpg saved to cache
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366b1d0>
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F33863d803cab4e168b8032acd2670203%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/9.jpg saved to cache
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46150241-ab67-52a9-bf8f-5fecb2aa1682
2026-03-25 22:49:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46150241-ab67-52a9-bf8f-5fecb2aa1682, skipping ID generation
2026-03-25 22:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46150241-ab67-52a9-bf8f-5fecb2aa1682 with scrape type 1
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46150241-ab67-52a9-bf8f-5fecb2aa1682 sending to next pipeline
2026-03-25 22:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46150241-ab67-52a9-bf8f-5fecb2aa1682, identifier: 1982448
2026-03-25 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/10.jpg not downloaded yet
2026-03-25 22:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-25 22:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448
2026-03-25 22:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46150241-ab67-52a9-bf8f-5fecb2aa1682 with identifier: 1982448 to the API
2026-03-25 22:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '46150241-ab67-52a9-bf8f-5fecb2aa1682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 98226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46150241-ab67-52a9-bf8f-5fecb2aa1682/46150241-ab67-52a9-bf8f-5fecb2aa1682_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/33863d803cab4e168b8032acd2670203/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982448%27 HTTP/1.1" 200 None
2026-03-25 22:49:58 [ayvens.be] INFO: Saving data for 1982448: {'created_time': 1774478998.739673, 'last_price_update_time': 1774478998.739682, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982448') HTTP/1.1" 204 0
2026-03-25 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:58 [ayvens.be] INFO: Found listing with ID: 1982451
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982451%27 HTTP/1.1" 200 None
2026-03-25 22:49:58 [ayvens.be] INFO: Scrape type for 1982451: 1
2026-03-25 22:49:58 [ayvens.be] INFO: Extracting data for car ID: 1982451
2026-03-25 22:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-25 22:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with scrape type 1
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/1.jpg not downloaded yet
2026-03-25 22:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/2.jpg not downloaded yet
2026-03-25 22:49:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815190>
2026-03-25 22:49:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F93395865c42c451eae8016f76f25aa44%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/8.jpg saved to cache
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5178048-2c9e-57b9-b033-270f599fcfcb
2026-03-25 22:49:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5178048-2c9e-57b9-b033-270f599fcfcb, skipping ID generation
2026-03-25 22:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5178048-2c9e-57b9-b033-270f599fcfcb with scrape type 1
2026-03-25 22:49:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5178048-2c9e-57b9-b033-270f599fcfcb sending to next pipeline
2026-03-25 22:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a5178048-2c9e-57b9-b033-270f599fcfcb, identifier: 1982447
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a361c90>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/2.jpg saved to cache
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d5290>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/3.jpg saved to cache
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364bc10>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/4.jpg saved to cache
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-25 22:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447
2026-03-25 22:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a5178048-2c9e-57b9-b033-270f599fcfcb with identifier: 1982447 to the API
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a5178048-2c9e-57b9-b033-270f599fcfcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 106638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 415586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5178048-2c9e-57b9-b033-270f599fcfcb/a5178048-2c9e-57b9-b033-270f599fcfcb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/93395865c42c451eae8016f76f25aa44/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982447%27 HTTP/1.1" 200 None
2026-03-25 22:49:59 [ayvens.be] INFO: Saving data for 1982447: {'created_time': 1774478999.740072, 'last_price_update_time': 1774478999.740081, 'auction_closing_time': 1774942200.0}
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982447') HTTP/1.1" 204 0
2026-03-25 22:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/3.jpg not downloaded yet
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/4.jpg not downloaded yet
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7bd90>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/8.jpg saved to cache
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64dc90>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/9.jpg saved to cache
2026-03-25 22:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc6b10>
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:49:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:49:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/6.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/5.jpg not downloaded yet
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/6.jpg not downloaded yet
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515dd0>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/7.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/7.jpg not downloaded yet
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/8.jpg not downloaded yet
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee2d0>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/1.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28dfa410>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/10.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/9.jpg not downloaded yet
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/10.jpg not downloaded yet
2026-03-25 22:50:00 [ayvens.be] INFO: Found listing with ID: 1982452
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982452%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [ayvens.be] INFO: Scrape type for 1982452: 1
2026-03-25 22:50:00 [ayvens.be] INFO: Extracting data for car ID: 1982452
2026-03-25 22:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-25 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with scrape type 1
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/1.jpg not downloaded yet
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1e1d0>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/5.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28767c50>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/2.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68850>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Feceb9743d00f478595f9fb0f3c36539c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/8.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 124521f8-a17b-51a0-b34b-df47fd238977
2026-03-25 22:50:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 124521f8-a17b-51a0-b34b-df47fd238977, skipping ID generation
2026-03-25 22:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124521f8-a17b-51a0-b34b-df47fd238977 with scrape type 1
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 124521f8-a17b-51a0-b34b-df47fd238977 sending to next pipeline
2026-03-25 22:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 124521f8-a17b-51a0-b34b-df47fd238977, identifier: 1982449
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8bd0>
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/4.jpg saved to cache
2026-03-25 22:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-25 22:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449
2026-03-25 22:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 124521f8-a17b-51a0-b34b-df47fd238977 with identifier: 1982449 to the API
2026-03-25 22:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '124521f8-a17b-51a0-b34b-df47fd238977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 88535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_124521f8-a17b-51a0-b34b-df47fd238977/124521f8-a17b-51a0-b34b-df47fd238977_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/eceb9743d00f478595f9fb0f3c36539c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (100KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (100KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982449%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [ayvens.be] INFO: Saving data for 1982449: {'created_time': 1774479001.256982, 'last_price_update_time': 1774479001.256991, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982449') HTTP/1.1" 204 0
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/2.jpg not downloaded yet
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/3.jpg not downloaded yet
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28917f50>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/3.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4410>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/5.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/4.jpg not downloaded yet
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/5.jpg not downloaded yet
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28827c10>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/7.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150d710>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/9.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7c10>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/1.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b78250>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/2.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/6.jpg not downloaded yet
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/7.jpg not downloaded yet
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21501050>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/8.jpg saved to cache
2026-03-25 22:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7650>
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/6.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/8.jpg not downloaded yet
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/9.jpg not downloaded yet
2026-03-25 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/10.jpg not downloaded yet
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e7d0>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F503bd121493742ca9e579b43856c4c70%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/10.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d457ea5-817c-5892-85d4-161dbe8956cc
2026-03-25 22:50:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d457ea5-817c-5892-85d4-161dbe8956cc, skipping ID generation
2026-03-25 22:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d457ea5-817c-5892-85d4-161dbe8956cc with scrape type 1
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d457ea5-817c-5892-85d4-161dbe8956cc sending to next pipeline
2026-03-25 22:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3d457ea5-817c-5892-85d4-161dbe8956cc, identifier: 1982450
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23693bd0>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/4.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884bc90>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/7.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b78090>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/3.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815e10>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/6.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ebad0>
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/7.jpg saved to cache
2026-03-25 22:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-25 22:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450
2026-03-25 22:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3d457ea5-817c-5892-85d4-161dbe8956cc with identifier: 1982450 to the API
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3d457ea5-817c-5892-85d4-161dbe8956cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 87507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d457ea5-817c-5892-85d4-161dbe8956cc/3d457ea5-817c-5892-85d4-161dbe8956cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/503bd121493742ca9e579b43856c4c70/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S AUTO GT',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982450%27 HTTP/1.1" 200 None
2026-03-25 22:50:02 [ayvens.be] INFO: Saving data for 1982450: {'created_time': 1774479002.980497, 'last_price_update_time': 1774479002.980507, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982450') HTTP/1.1" 204 0
2026-03-25 22:50:03 [ayvens.be] INFO: Found listing with ID: 1982453
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982453%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [ayvens.be] INFO: Scrape type for 1982453: 1
2026-03-25 22:50:03 [ayvens.be] INFO: Extracting data for car ID: 1982453
2026-03-25 22:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-25 22:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a with scrape type 1
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/1.jpg not downloaded yet
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/2.jpg not downloaded yet
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae55d0>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/5.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23668150>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/1.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21512e50>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/8.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/3.jpg not downloaded yet
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/4.jpg not downloaded yet
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d5310>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/2.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a75c890>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/9.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a357910>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F7ce90ecf78204967b98df8683d6975b5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/10.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100
2026-03-25 22:50:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 334d5026-7bd1-5ecd-b307-f4eeeee4f100, skipping ID generation
2026-03-25 22:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with scrape type 1
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 334d5026-7bd1-5ecd-b307-f4eeeee4f100 sending to next pipeline
2026-03-25 22:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 334d5026-7bd1-5ecd-b307-f4eeeee4f100, identifier: 1982451
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ee490>
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/3.jpg saved to cache
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-25 22:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451
2026-03-25 22:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 334d5026-7bd1-5ecd-b307-f4eeeee4f100 with identifier: 1982451 to the API
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '334d5026-7bd1-5ecd-b307-f4eeeee4f100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 90608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284493,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_334d5026-7bd1-5ecd-b307-f4eeeee4f100/334d5026-7bd1-5ecd-b307-f4eeeee4f100_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/7ce90ecf78204967b98df8683d6975b5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982451%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [ayvens.be] INFO: Saving data for 1982451: {'created_time': 1774479003.959583, 'last_price_update_time': 1774479003.959593, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982451') HTTP/1.1" 204 0
2026-03-25 22:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/5.jpg not downloaded yet
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/6.jpg not downloaded yet
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28906110>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/4.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f3e50>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F78a7858861f94852bded156fca0475b1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/6.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6
2026-03-25 22:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6, skipping ID generation
2026-03-25 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with scrape type 1
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 sending to next pipeline
2026-03-25 22:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6, identifier: 1982446
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/7.jpg not downloaded yet
2026-03-25 22:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-25 22:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446
2026-03-25 22:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6 with identifier: 1982446 to the API
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 117065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6/dd475d9c-aaf5-52f3-8d5e-d9ffb116b3e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/78a7858861f94852bded156fca0475b1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 40 TDI S TRONIC QUATTRO B. ED. ADV',
 'transmission': 'automatic',
 'trim': '2.0 40 TDI S TRONIC QUATTRO B. ED. ADV',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982446%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [ayvens.be] INFO: Saving data for 1982446: {'created_time': 1774479004.60505, 'last_price_update_time': 1774479004.60506, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982446') HTTP/1.1" 204 0
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/8.jpg not downloaded yet
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23602090>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/8.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1f810>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/5.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42e50>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/6.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/9.jpg not downloaded yet
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/10.jpg not downloaded yet
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368c990>
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Feaf4299ab29742acb3a3ede96e9c5322%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/5.jpg saved to cache
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e
2026-03-25 22:50:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e, skipping ID generation
2026-03-25 22:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with scrape type 1
2026-03-25 22:50:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e sending to next pipeline
2026-03-25 22:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e, identifier: 1982438
2026-03-25 22:50:05 [ayvens.be] INFO: Found listing with ID: 1982454
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982454%27 HTTP/1.1" 200 None
2026-03-25 22:50:05 [ayvens.be] INFO: Scrape type for 1982454: 1
2026-03-25 22:50:05 [ayvens.be] INFO: Extracting data for car ID: 1982454
2026-03-25 22:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-25 22:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with scrape type 1
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/1.jpg not downloaded yet
2026-03-25 22:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-25 22:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438
2026-03-25 22:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e with identifier: 1982438 to the API
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 101949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e/bf56811e-d6bb-5ebc-b1f9-858a9a9a3d1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/eaf4299ab29742acb3a3ede96e9c5322/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV R-DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV R-DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982438%27 HTTP/1.1" 200 None
2026-03-25 22:50:05 [ayvens.be] INFO: Saving data for 1982438: {'created_time': 1774479005.502128, 'last_price_update_time': 1774479005.502141, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982438') HTTP/1.1" 204 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/2.jpg not downloaded yet
2026-03-25 22:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215120d0>
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/10.jpg saved to cache
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236af290>
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/7.jpg saved to cache
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28790510>
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yk%252F8ee8c66f431d4442a99f2e8e2da687f8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/10.jpg saved to cache
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76f4aa23-fa08-539a-9861-8e6329050ac7
2026-03-25 22:50:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76f4aa23-fa08-539a-9861-8e6329050ac7, skipping ID generation
2026-03-25 22:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f4aa23-fa08-539a-9861-8e6329050ac7 with scrape type 1
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76f4aa23-fa08-539a-9861-8e6329050ac7 sending to next pipeline
2026-03-25 22:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 76f4aa23-fa08-539a-9861-8e6329050ac7, identifier: 1982436
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0f190>
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/9.jpg saved to cache
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2c10>
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F33a075f7c4774c629555451e67212818%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/7.jpg saved to cache
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e269c9ed-ab32-5654-928d-86dbafcc8c10
2026-03-25 22:50:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e269c9ed-ab32-5654-928d-86dbafcc8c10, skipping ID generation
2026-03-25 22:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e269c9ed-ab32-5654-928d-86dbafcc8c10 with scrape type 1
2026-03-25 22:50:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e269c9ed-ab32-5654-928d-86dbafcc8c10 sending to next pipeline
2026-03-25 22:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e269c9ed-ab32-5654-928d-86dbafcc8c10, identifier: 1982445
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a69010>
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/10.jpg saved to cache
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/3.jpg not downloaded yet
2026-03-25 22:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-25 22:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436
2026-03-25 22:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 76f4aa23-fa08-539a-9861-8e6329050ac7 with identifier: 1982436 to the API
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '76f4aa23-fa08-539a-9861-8e6329050ac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT DIESEL - 2020',
 'odometer': 148208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f4aa23-fa08-539a-9861-8e6329050ac7/76f4aa23-fa08-539a-9861-8e6329050ac7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yk/8ee8c66f431d4442a99f2e8e2da687f8/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT DIESEL - 2020 30 TDi',
 'transmission': 'manual',
 'trim': '30 TDi',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982436%27 HTTP/1.1" 200 None
2026-03-25 22:50:06 [ayvens.be] INFO: Saving data for 1982436: {'created_time': 1774479006.516343, 'last_price_update_time': 1774479006.516353, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982436') HTTP/1.1" 204 0
2026-03-25 22:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-25 22:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445
2026-03-25 22:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e269c9ed-ab32-5654-928d-86dbafcc8c10 with identifier: 1982445 to the API
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e269c9ed-ab32-5654-928d-86dbafcc8c10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 120789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 891736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e269c9ed-ab32-5654-928d-86dbafcc8c10/e269c9ed-ab32-5654-928d-86dbafcc8c10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 789195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/33a075f7c4774c629555451e67212818/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982445%27 HTTP/1.1" 200 None
2026-03-25 22:50:06 [ayvens.be] INFO: Saving data for 1982445: {'created_time': 1774479006.851433, 'last_price_update_time': 1774479006.851445, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982445') HTTP/1.1" 204 0
2026-03-25 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 152 items (at 33 items/min)
2026-03-25 22:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/4.jpg not downloaded yet
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b5ad0>
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/1.jpg saved to cache
2026-03-25 22:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/5.jpg not downloaded yet
2026-03-25 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/6.jpg not downloaded yet
2026-03-25 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890de10>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F4b7c010dbe904c0392408a42d5c169a4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/8.jpg saved to cache
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b
2026-03-25 22:50:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b, skipping ID generation
2026-03-25 22:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with scrape type 1
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8379ce6a-5c44-5957-9b56-b8dfd0fc742b sending to next pipeline
2026-03-25 22:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b, identifier: 1982452
2026-03-25 22:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/7.jpg not downloaded yet
2026-03-25 22:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-25 22:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452
2026-03-25 22:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8379ce6a-5c44-5957-9b56-b8dfd0fc742b with identifier: 1982452 to the API
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8379ce6a-5c44-5957-9b56-b8dfd0fc742b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 111609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8379ce6a-5c44-5957-9b56-b8dfd0fc742b/8379ce6a-5c44-5957-9b56-b8dfd0fc742b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/4b7c010dbe904c0392408a42d5c169a4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 1.5 P300E PHEV S 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 P300E PHEV S 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982452%27 HTTP/1.1" 200 None
2026-03-25 22:50:07 [ayvens.be] INFO: Saving data for 1982452: {'created_time': 1774479007.655769, 'last_price_update_time': 1774479007.655778, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982452') HTTP/1.1" 204 0
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287987d0>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/9.jpg saved to cache
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/8.jpg not downloaded yet
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236eb450>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/2.jpg saved to cache
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ef950>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/5.jpg saved to cache
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766810>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/4.jpg saved to cache
2026-03-25 22:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a05110>
2026-03-25 22:50:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/3.jpg saved to cache
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799090>
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/8.jpg saved to cache
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/9.jpg not downloaded yet
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/10.jpg not downloaded yet
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [ayvens.be] INFO: Found listing with ID: 1982455
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982455%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [ayvens.be] INFO: Scrape type for 1982455: 1
2026-03-25 22:50:08 [ayvens.be] INFO: Extracting data for car ID: 1982455
2026-03-25 22:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-25 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5937440-5f5a-5726-91e1-234d4722949e with scrape type 1
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/1.jpg not downloaded yet
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/2.jpg not downloaded yet
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/3.jpg not downloaded yet
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28905650>
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F0d1c5aca51c84fcd9395b9b804f41a41%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/7.jpg saved to cache
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7edd12e-9682-5d8d-ab36-625f82b84ab4
2026-03-25 22:50:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7edd12e-9682-5d8d-ab36-625f82b84ab4, skipping ID generation
2026-03-25 22:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7edd12e-9682-5d8d-ab36-625f82b84ab4 with scrape type 1
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7edd12e-9682-5d8d-ab36-625f82b84ab4 sending to next pipeline
2026-03-25 22:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7edd12e-9682-5d8d-ab36-625f82b84ab4, identifier: 1982428
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/4.jpg not downloaded yet
2026-03-25 22:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-25 22:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428
2026-03-25 22:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7edd12e-9682-5d8d-ab36-625f82b84ab4 with identifier: 1982428 to the API
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e7edd12e-9682-5d8d-ab36-625f82b84ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 78365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7edd12e-9682-5d8d-ab36-625f82b84ab4/e7edd12e-9682-5d8d-ab36-625f82b84ab4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/0d1c5aca51c84fcd9395b9b804f41a41/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982428%27 HTTP/1.1" 200 None
2026-03-25 22:50:08 [ayvens.be] INFO: Saving data for 1982428: {'created_time': 1774479008.963794, 'last_price_update_time': 1774479008.963805, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982428') HTTP/1.1" 204 0
2026-03-25 22:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/5.jpg not downloaded yet
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2876db50>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/7.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8790>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/9.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b6890>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/6.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21500650>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/8.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8290>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/8.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361d8d0>
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F02ea77127e31409987407847bb2c3aba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/7.jpg saved to cache
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 006794fd-0d45-53d2-ad92-893dde83a26f
2026-03-25 22:50:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 006794fd-0d45-53d2-ad92-893dde83a26f, skipping ID generation
2026-03-25 22:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006794fd-0d45-53d2-ad92-893dde83a26f with scrape type 1
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 006794fd-0d45-53d2-ad92-893dde83a26f sending to next pipeline
2026-03-25 22:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 006794fd-0d45-53d2-ad92-893dde83a26f, identifier: 1982427
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/6.jpg not downloaded yet
2026-03-25 22:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-25 22:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427
2026-03-25 22:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 006794fd-0d45-53d2-ad92-893dde83a26f with identifier: 1982427 to the API
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '006794fd-0d45-53d2-ad92-893dde83a26f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 147007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_006794fd-0d45-53d2-ad92-893dde83a26f/006794fd-0d45-53d2-ad92-893dde83a26f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/02ea77127e31409987407847bb2c3aba/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318DA (110KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982427%27 HTTP/1.1" 200 None
2026-03-25 22:50:09 [ayvens.be] INFO: Saving data for 1982427: {'created_time': 1774479009.980068, 'last_price_update_time': 1774479009.98008, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982427') HTTP/1.1" 204 0
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/7.jpg not downloaded yet
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23626890>
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yg%252F75f189cb2d1d40db9bf47c84da7a1cf0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/8.jpg saved to cache
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad
2026-03-25 22:50:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad, skipping ID generation
2026-03-25 22:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with scrape type 1
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a18994d-ec49-587d-b063-6d3fb6bdd9ad sending to next pipeline
2026-03-25 22:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad, identifier: 1982426
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-25 22:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426
2026-03-25 22:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a18994d-ec49-587d-b063-6d3fb6bdd9ad with identifier: 1982426 to the API
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '3a18994d-ec49-587d-b063-6d3fb6bdd9ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 78998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 799297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a18994d-ec49-587d-b063-6d3fb6bdd9ad/3a18994d-ec49-587d-b063-6d3fb6bdd9ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yg/75f189cb2d1d40db9bf47c84da7a1cf0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L2 Standard '
          'Premium S&S',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L2 Standard Premium S&S',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982426%27 HTTP/1.1" 200 None
2026-03-25 22:50:10 [ayvens.be] INFO: Saving data for 1982426: {'created_time': 1774479010.518353, 'last_price_update_time': 1774479010.518362, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982426') HTTP/1.1" 204 0
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/8.jpg not downloaded yet
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/9.jpg not downloaded yet
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28dfad10>
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Fb6262118602a41969712f40fac0903eb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/10.jpg saved to cache
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a
2026-03-25 22:50:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9370e14-c0eb-5ddf-8842-2b34b9c2017a, skipping ID generation
2026-03-25 22:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a with scrape type 1
2026-03-25 22:50:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9370e14-c0eb-5ddf-8842-2b34b9c2017a sending to next pipeline
2026-03-25 22:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e9370e14-c0eb-5ddf-8842-2b34b9c2017a, identifier: 1982453
2026-03-25 22:50:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-25 22:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453
2026-03-25 22:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e9370e14-c0eb-5ddf-8842-2b34b9c2017a with identifier: 1982453 to the API
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e9370e14-c0eb-5ddf-8842-2b34b9c2017a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER',
 'odometer': 85509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9370e14-c0eb-5ddf-8842-2b34b9c2017a/e9370e14-c0eb-5ddf-8842-2b34b9c2017a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/b6262118602a41969712f40fac0903eb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER 1.5 ECOBLUE 88KW ST-LINE',
 'transmission': 'manual',
 'trim': '1.5 ECOBLUE 88KW ST-LINE',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982453%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [ayvens.be] INFO: Saving data for 1982453: {'created_time': 1774479011.087251, 'last_price_update_time': 1774479011.087262, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982453') HTTP/1.1" 204 0
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/10.jpg not downloaded yet
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21513b10>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/5.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a51750>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/3.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28904a90>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/4.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ec810>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/2.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [ayvens.be] INFO: Found listing with ID: 1982456
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982456%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [ayvens.be] INFO: Scrape type for 1982456: 1
2026-03-25 22:50:11 [ayvens.be] INFO: Extracting data for car ID: 1982456
2026-03-25 22:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-25 22:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb with scrape type 1
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/1.jpg not downloaded yet
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a639210>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/1.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/2.jpg not downloaded yet
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/3.jpg not downloaded yet
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688710>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/3.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa2450>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/6.jpg saved to cache
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/4.jpg not downloaded yet
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/5.jpg not downloaded yet
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/6.jpg not downloaded yet
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/7.jpg not downloaded yet
2026-03-25 22:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/8.jpg not downloaded yet
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/9.jpg not downloaded yet
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/10.jpg not downloaded yet
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b4310>
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/10.jpg saved to cache
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:12 [ayvens.be] INFO: Found listing with ID: 1982457
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982457%27 HTTP/1.1" 200 None
2026-03-25 22:50:12 [ayvens.be] INFO: Scrape type for 1982457: 1
2026-03-25 22:50:12 [ayvens.be] INFO: Extracting data for car ID: 1982457
2026-03-25 22:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-25 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98e6b75-f185-59ed-bb03-81af154fd551 with scrape type 1
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/1.jpg not downloaded yet
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363e910>
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/8.jpg saved to cache
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64db50>
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/1.jpg saved to cache
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b98d50>
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/9.jpg saved to cache
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362d1d0>
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fe0551781db834797b22432a9efca8877%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/7.jpg saved to cache
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0
2026-03-25 22:50:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0, skipping ID generation
2026-03-25 22:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with scrape type 1
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 sending to next pipeline
2026-03-25 22:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0, identifier: 1982454
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/2.jpg not downloaded yet
2026-03-25 22:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-25 22:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454
2026-03-25 22:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 217ee1da-dc21-5227-8fe5-b861fcdd2aa0 with identifier: 1982454 to the API
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '217ee1da-dc21-5227-8fe5-b861fcdd2aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 88839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_217ee1da-dc21-5227-8fe5-b861fcdd2aa0/217ee1da-dc21-5227-8fe5-b861fcdd2aa0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/e0551781db834797b22432a9efca8877/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 316DA (90KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) TOURING',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982454%27 HTTP/1.1" 200 None
2026-03-25 22:50:12 [ayvens.be] INFO: Saving data for 1982454: {'created_time': 1774479012.9934, 'last_price_update_time': 1774479012.99341, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982454') HTTP/1.1" 204 0
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/3.jpg not downloaded yet
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc5190>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/2.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5d790>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/2.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236db710>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/5.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/4.jpg not downloaded yet
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/5.jpg not downloaded yet
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a6392d0>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/8.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9bb10>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/7.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/6.jpg not downloaded yet
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/7.jpg not downloaded yet
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/8.jpg not downloaded yet
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5da10>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/4.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749d50>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/6.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236edd10>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/3.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878a5d0>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/9.jpg saved to cache
2026-03-25 22:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e35d0>
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F63c44863c627474e959bd96c885ba635%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/10.jpg saved to cache
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5937440-5f5a-5726-91e1-234d4722949e
2026-03-25 22:50:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5937440-5f5a-5726-91e1-234d4722949e, skipping ID generation
2026-03-25 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5937440-5f5a-5726-91e1-234d4722949e with scrape type 1
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5937440-5f5a-5726-91e1-234d4722949e sending to next pipeline
2026-03-25 22:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5937440-5f5a-5726-91e1-234d4722949e, identifier: 1982455
2026-03-25 22:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-25 22:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455
2026-03-25 22:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5937440-5f5a-5726-91e1-234d4722949e with identifier: 1982455 to the API
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e5937440-5f5a-5726-91e1-234d4722949e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'ES',
 'odometer': 110761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613644,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5937440-5f5a-5726-91e1-234d4722949e/e5937440-5f5a-5726-91e1-234d4722949e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/63c44863c627474e959bd96c885ba635/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS ES 2.5 300H HEV EXPLORE LINE',
 'transmission': 'automatic',
 'trim': '2.5 300H HEV EXPLORE LINE',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982455%27 HTTP/1.1" 200 None
2026-03-25 22:50:14 [ayvens.be] INFO: Saving data for 1982455: {'created_time': 1774479014.514879, 'last_price_update_time': 1774479014.514891, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982455') HTTP/1.1" 204 0
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/9.jpg not downloaded yet
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/10.jpg not downloaded yet
2026-03-25 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236017d0>
2026-03-25 22:50:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fd7a9aa18e37a4c1c87936c01b389c31a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/1.jpg saved to cache
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 571a6f12-7561-5f91-ab27-6e3d36589c28
2026-03-25 22:50:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 571a6f12-7561-5f91-ab27-6e3d36589c28, skipping ID generation
2026-03-25 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 571a6f12-7561-5f91-ab27-6e3d36589c28 with scrape type 1
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 571a6f12-7561-5f91-ab27-6e3d36589c28 sending to next pipeline
2026-03-25 22:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 571a6f12-7561-5f91-ab27-6e3d36589c28, identifier: 1982183
2026-03-25 22:50:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:14 [ayvens.be] INFO: Found listing with ID: 1982458
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982458%27 HTTP/1.1" 200 None
2026-03-25 22:50:14 [ayvens.be] INFO: Scrape type for 1982458: 1
2026-03-25 22:50:14 [ayvens.be] INFO: Extracting data for car ID: 1982458
2026-03-25 22:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-25 22:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with scrape type 1
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/1.jpg not downloaded yet
2026-03-25 22:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 571a6f12-7561-5f91-ab27-6e3d36589c28 with identifier: 1982183
2026-03-25 22:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 571a6f12-7561-5f91-ab27-6e3d36589c28 with identifier: 1982183
2026-03-25 22:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 571a6f12-7561-5f91-ab27-6e3d36589c28 with identifier: 1982183 to the API
2026-03-25 22:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '571a6f12-7561-5f91-ab27-6e3d36589c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 21201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 936839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 838080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571a6f12-7561-5f91-ab27-6e3d36589c28/571a6f12-7561-5f91-ab27-6e3d36589c28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/d7a9aa18e37a4c1c87936c01b389c31a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982183%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [ayvens.be] INFO: Saving data for 1982183: {'created_time': 1774479015.108109, 'last_price_update_time': 1774479015.108119, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982183') HTTP/1.1" 204 0
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/2.jpg not downloaded yet
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362ea10>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/3.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/3.jpg not downloaded yet
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb69d0>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/1.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/4.jpg not downloaded yet
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d8850>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/2.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/5.jpg not downloaded yet
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/6.jpg not downloaded yet
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362cfd0>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/1.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368d410>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/6.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892c8d0>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/4.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368ccd0>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/10.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7da90>
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/5.jpg saved to cache
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/7.jpg not downloaded yet
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/8.jpg not downloaded yet
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/9.jpg not downloaded yet
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/10.jpg not downloaded yet
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:15 [ayvens.be] INFO: Found listing with ID: 1982459
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982459%27 HTTP/1.1" 200 None
2026-03-25 22:50:15 [ayvens.be] INFO: Scrape type for 1982459: 1
2026-03-25 22:50:15 [ayvens.be] INFO: Extracting data for car ID: 1982459
2026-03-25 22:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-25 22:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f with scrape type 1
2026-03-25 22:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/1.jpg not downloaded yet
2026-03-25 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/2.jpg not downloaded yet
2026-03-25 22:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368f790>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/2.jpg saved to cache
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/3.jpg not downloaded yet
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2c890>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/10.jpg saved to cache
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/4.jpg not downloaded yet
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/5.jpg not downloaded yet
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e9310>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/3.jpg saved to cache
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e0a90>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/4.jpg saved to cache
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ca90>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/9.jpg saved to cache
2026-03-25 22:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e850>
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/8.jpg saved to cache
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28849950>
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/5.jpg saved to cache
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ea010>
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F892c767a299c49849379ea406fb3c990%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/7.jpg saved to cache
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb
2026-03-25 22:50:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 680145e4-e929-5ac8-a9fc-3c7d2628abbb, skipping ID generation
2026-03-25 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb with scrape type 1
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 680145e4-e929-5ac8-a9fc-3c7d2628abbb sending to next pipeline
2026-03-25 22:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 680145e4-e929-5ac8-a9fc-3c7d2628abbb, identifier: 1982456
2026-03-25 22:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-25 22:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456
2026-03-25 22:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 680145e4-e929-5ac8-a9fc-3c7d2628abbb with identifier: 1982456 to the API
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '680145e4-e929-5ac8-a9fc-3c7d2628abbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 93864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595620,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_680145e4-e929-5ac8-a9fc-3c7d2628abbb/680145e4-e929-5ac8-a9fc-3c7d2628abbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/892c767a299c49849379ea406fb3c990/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982456%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [ayvens.be] INFO: Saving data for 1982456: {'created_time': 1774479017.841809, 'last_price_update_time': 1774479017.841819, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982456') HTTP/1.1" 204 0
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/6.jpg not downloaded yet
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/7.jpg not downloaded yet
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/8.jpg not downloaded yet
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/9.jpg not downloaded yet
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/10.jpg not downloaded yet
2026-03-25 22:50:17 [ayvens.be] INFO: Found listing with ID: 1982460
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982460%27 HTTP/1.1" 200 None
2026-03-25 22:50:17 [ayvens.be] INFO: Scrape type for 1982460: 1
2026-03-25 22:50:17 [ayvens.be] INFO: Extracting data for car ID: 1982460
2026-03-25 22:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-25 22:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ba1b1c-b18f-5649-8f03-bc82dc358998 with scrape type 1
2026-03-25 22:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/1.jpg not downloaded yet
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/2.jpg not downloaded yet
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236434d0>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/9.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366bcd0>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/10.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/3.jpg not downloaded yet
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/4.jpg not downloaded yet
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/5.jpg not downloaded yet
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881b190>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/8.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883ecd0>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/7.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7650>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xh%252F63c56b0310ca462a8ba30b91030d65d5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/6.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e98e6b75-f185-59ed-bb03-81af154fd551
2026-03-25 22:50:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e98e6b75-f185-59ed-bb03-81af154fd551, skipping ID generation
2026-03-25 22:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98e6b75-f185-59ed-bb03-81af154fd551 with scrape type 1
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e98e6b75-f185-59ed-bb03-81af154fd551 sending to next pipeline
2026-03-25 22:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e98e6b75-f185-59ed-bb03-81af154fd551, identifier: 1982457
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ff6750>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/3.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cb550>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/1.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880bed0>
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/2.jpg saved to cache
2026-03-25 22:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-25 22:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457
2026-03-25 22:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e98e6b75-f185-59ed-bb03-81af154fd551 with identifier: 1982457 to the API
2026-03-25 22:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e98e6b75-f185-59ed-bb03-81af154fd551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 117920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e98e6b75-f185-59ed-bb03-81af154fd551/e98e6b75-f185-59ed-bb03-81af154fd551_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xh/63c56b0310ca462a8ba30b91030d65d5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 HYBRID DYNAMIC BUSINESS E-CVT',
 'transmission': 'automatic',
 'trim': '2.5 HYBRID DYNAMIC BUSINESS E-CVT',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982457%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [ayvens.be] INFO: Saving data for 1982457: {'created_time': 1774479019.188729, 'last_price_update_time': 1774479019.188743, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982457') HTTP/1.1" 204 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/6.jpg not downloaded yet
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/7.jpg not downloaded yet
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28748fd0>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/7.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/8.jpg not downloaded yet
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/9.jpg not downloaded yet
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515350>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/6.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/10.jpg not downloaded yet
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ae50>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/3.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:19 [ayvens.be] INFO: Found listing with ID: 1982461
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982461%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [ayvens.be] INFO: Scrape type for 1982461: 1
2026-03-25 22:50:19 [ayvens.be] INFO: Extracting data for car ID: 1982461
2026-03-25 22:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-25 22:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727ae113-be3c-5cd8-819d-c53d0943f35d with scrape type 1
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/1.jpg not downloaded yet
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515d90>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/4.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28babc50>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/5.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289175d0>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/8.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/2.jpg not downloaded yet
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/3.jpg not downloaded yet
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28791390>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/10.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28dfa210>
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252Fe8cdeb20cc03454c976da225eaf9da94%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/9.jpg saved to cache
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1
2026-03-25 22:50:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1, skipping ID generation
2026-03-25 22:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with scrape type 1
2026-03-25 22:50:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 sending to next pipeline
2026-03-25 22:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1, identifier: 1982458
2026-03-25 22:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-25 22:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458
2026-03-25 22:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1 with identifier: 1982458 to the API
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 85391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 723527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775264,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 828308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1/f2fc4b69-4ee2-5ab1-b8c3-0ffdb618c2f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/e8cdeb20cc03454c976da225eaf9da94/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982458%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [ayvens.be] INFO: Saving data for 1982458: {'created_time': 1774479020.435229, 'last_price_update_time': 1774479020.435238, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982458') HTTP/1.1" 204 0
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/4.jpg not downloaded yet
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/5.jpg not downloaded yet
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/6.jpg not downloaded yet
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/7.jpg not downloaded yet
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/8.jpg not downloaded yet
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/9.jpg not downloaded yet
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22e50>
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/5.jpg saved to cache
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/10.jpg not downloaded yet
2026-03-25 22:50:20 [ayvens.be] INFO: Found listing with ID: 1982462
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982462%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [ayvens.be] INFO: Scrape type for 1982462: 1
2026-03-25 22:50:20 [ayvens.be] INFO: Extracting data for car ID: 1982462
2026-03-25 22:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-25 22:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf with scrape type 1
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/1.jpg not downloaded yet
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/2.jpg not downloaded yet
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289361d0>
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/3.jpg saved to cache
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21521c10>
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/10.jpg saved to cache
2026-03-25 22:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28774d50>
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/2.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881e690>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/1.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2ac77250>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/4.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f4d50>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/9.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4d10>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/8.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/3.jpg not downloaded yet
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/4.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/5.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/6.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/7.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/8.jpg not downloaded yet
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/9.jpg not downloaded yet
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/10.jpg not downloaded yet
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ebd0>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/5.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28775b10>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/6.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [ayvens.be] INFO: Found listing with ID: 1982463
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982463%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [ayvens.be] INFO: Scrape type for 1982463: 1
2026-03-25 22:50:21 [ayvens.be] INFO: Extracting data for car ID: 1982463
2026-03-25 22:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-25 22:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b with scrape type 1
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/1.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/2.jpg not downloaded yet
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/3.jpg not downloaded yet
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288eb750>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/4.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5dcd0>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/7.jpg saved to cache
2026-03-25 22:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9b610>
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/9.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa2dd0>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/8.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7ad50>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/6.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5cb50>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/7.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/4.jpg not downloaded yet
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/5.jpg not downloaded yet
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b98a50>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/3.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23641c50>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/1.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ded0>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/2.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b09b10>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/10.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/6.jpg not downloaded yet
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/7.jpg not downloaded yet
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/8.jpg not downloaded yet
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b07d0>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/4.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361c050>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/5.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363e890>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/4.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215133d0>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/3.jpg saved to cache
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/9.jpg not downloaded yet
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/10.jpg not downloaded yet
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d9050>
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/2.jpg saved to cache
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881fb10>
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F50e8428bd7f148f697d85ca2f42fc8e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/10.jpg saved to cache
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31ba1b1c-b18f-5649-8f03-bc82dc358998
2026-03-25 22:50:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31ba1b1c-b18f-5649-8f03-bc82dc358998, skipping ID generation
2026-03-25 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ba1b1c-b18f-5649-8f03-bc82dc358998 with scrape type 1
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31ba1b1c-b18f-5649-8f03-bc82dc358998 sending to next pipeline
2026-03-25 22:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 31ba1b1c-b18f-5649-8f03-bc82dc358998, identifier: 1982460
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883eb50>
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/2.jpg saved to cache
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2881bc10>
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/5.jpg saved to cache
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21501050>
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/10.jpg saved to cache
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:23 [ayvens.be] INFO: Found listing with ID: 1982464
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982464%27 HTTP/1.1" 200 None
2026-03-25 22:50:23 [ayvens.be] INFO: Scrape type for 1982464: 1
2026-03-25 22:50:23 [ayvens.be] INFO: Extracting data for car ID: 1982464
2026-03-25 22:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-25 22:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69d499af-3843-575a-be0e-d5894765409c with scrape type 1
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/1.jpg not downloaded yet
2026-03-25 22:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-25 22:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460
2026-03-25 22:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 31ba1b1c-b18f-5649-8f03-bc82dc358998 with identifier: 1982460 to the API
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '31ba1b1c-b18f-5649-8f03-bc82dc358998',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 110356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31ba1b1c-b18f-5649-8f03-bc82dc358998/31ba1b1c-b18f-5649-8f03-bc82dc358998_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/50e8428bd7f148f697d85ca2f42fc8e3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982460%27 HTTP/1.1" 200 None
2026-03-25 22:50:23 [ayvens.be] INFO: Saving data for 1982460: {'created_time': 1774479023.903214, 'last_price_update_time': 1774479023.903223, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982460') HTTP/1.1" 204 0
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/2.jpg not downloaded yet
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/3.jpg not downloaded yet
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0e010>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/9.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23691950>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/6.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236451d0>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/1.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/4.jpg not downloaded yet
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/5.jpg not downloaded yet
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362cb50>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/8.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2877d3d0>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/7.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fc590>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F7b075ba503d44d6997bd3ff662c0f2a1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/1.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf
2026-03-25 22:50:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d58fe7a9-29b5-53a0-8f5f-57935b9876bf, skipping ID generation
2026-03-25 22:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf with scrape type 1
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d58fe7a9-29b5-53a0-8f5f-57935b9876bf sending to next pipeline
2026-03-25 22:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d58fe7a9-29b5-53a0-8f5f-57935b9876bf, identifier: 1982462
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23647010>
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/9.jpg saved to cache
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/6.jpg not downloaded yet
2026-03-25 22:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-25 22:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462
2026-03-25 22:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d58fe7a9-29b5-53a0-8f5f-57935b9876bf with identifier: 1982462 to the API
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd58fe7a9-29b5-53a0-8f5f-57935b9876bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 88626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58fe7a9-29b5-53a0-8f5f-57935b9876bf/d58fe7a9-29b5-53a0-8f5f-57935b9876bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/7b075ba503d44d6997bd3ff662c0f2a1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 130PS TREND FWD 300 LWB',
 'transmission': 'manual',
 'trim': '2.0TD 130PS TREND FWD 300 LWB',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982462%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [ayvens.be] INFO: Saving data for 1982462: {'created_time': 1774479025.090594, 'last_price_update_time': 1774479025.090606, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982462') HTTP/1.1" 204 0
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/7.jpg not downloaded yet
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/8.jpg not downloaded yet
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236468d0>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/2.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ad350>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/3.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b99ed0>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/8.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/9.jpg not downloaded yet
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/10.jpg not downloaded yet
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ec50>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/4.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [ayvens.be] INFO: Found listing with ID: 1982465
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982465%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [ayvens.be] INFO: Scrape type for 1982465: 1
2026-03-25 22:50:25 [ayvens.be] INFO: Extracting data for car ID: 1982465
2026-03-25 22:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-25 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f050986b-f470-5a9e-af76-068d8f4cf6e6 with scrape type 1
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/1.jpg not downloaded yet
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/2.jpg not downloaded yet
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/3.jpg not downloaded yet
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287770d0>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/5.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151a850>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/6.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ac810>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/7.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/4.jpg not downloaded yet
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/5.jpg not downloaded yet
2026-03-25 22:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a68a10>
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ca%252F9aadff52120b49628f78a07a7b893750%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/6.jpg saved to cache
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 727ae113-be3c-5cd8-819d-c53d0943f35d
2026-03-25 22:50:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 727ae113-be3c-5cd8-819d-c53d0943f35d, skipping ID generation
2026-03-25 22:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 727ae113-be3c-5cd8-819d-c53d0943f35d with scrape type 1
2026-03-25 22:50:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 727ae113-be3c-5cd8-819d-c53d0943f35d sending to next pipeline
2026-03-25 22:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 727ae113-be3c-5cd8-819d-c53d0943f35d, identifier: 1982461
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369ec10>
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/7.jpg saved to cache
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28776590>
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/9.jpg saved to cache
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/6.jpg not downloaded yet
2026-03-25 22:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-25 22:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461
2026-03-25 22:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 727ae113-be3c-5cd8-819d-c53d0943f35d with identifier: 1982461 to the API
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '727ae113-be3c-5cd8-819d-c53d0943f35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 100708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_727ae113-be3c-5cd8-819d-c53d0943f35d/727ae113-be3c-5cd8-819d-c53d0943f35d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ca/9aadff52120b49628f78a07a7b893750/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982461%27 HTTP/1.1" 200 None
2026-03-25 22:50:26 [ayvens.be] INFO: Saving data for 1982461: {'created_time': 1774479026.600928, 'last_price_update_time': 1774479026.600938, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982461') HTTP/1.1" 204 0
2026-03-25 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/7.jpg not downloaded yet
2026-03-25 22:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/8.jpg not downloaded yet
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883cfd0>
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/8.jpg saved to cache
2026-03-25 22:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23645cd0>
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F4a3c5eb70b1240189686ac5b2388ab37%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/10.jpg saved to cache
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b
2026-03-25 22:50:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e3a40c-f91b-586f-9246-b79dc3c5b78b, skipping ID generation
2026-03-25 22:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b with scrape type 1
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e3a40c-f91b-586f-9246-b79dc3c5b78b sending to next pipeline
2026-03-25 22:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2e3a40c-f91b-586f-9246-b79dc3c5b78b, identifier: 1982463
2026-03-25 22:50:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287d3e10>
2026-03-25 22:50:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252F1ca04215ae6e469caf0e34e3973f2a83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/1.jpg saved to cache
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f
2026-03-25 22:50:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10a5e25e-516f-5f87-bbbb-30b29f313e8f, skipping ID generation
2026-03-25 22:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f with scrape type 1
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10a5e25e-516f-5f87-bbbb-30b29f313e8f sending to next pipeline
2026-03-25 22:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10a5e25e-516f-5f87-bbbb-30b29f313e8f, identifier: 1982459
2026-03-25 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-25 22:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463
2026-03-25 22:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2e3a40c-f91b-586f-9246-b79dc3c5b78b with identifier: 1982463 to the API
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e2e3a40c-f91b-586f-9246-b79dc3c5b78b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 87111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e3a40c-f91b-586f-9246-b79dc3c5b78b/e2e3a40c-f91b-586f-9246-b79dc3c5b78b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/4a3c5eb70b1240189686ac5b2388ab37/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2023}
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982463%27 HTTP/1.1" 200 None
2026-03-25 22:50:27 [ayvens.be] INFO: Saving data for 1982463: {'created_time': 1774479027.61123, 'last_price_update_time': 1774479027.61124, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982463') HTTP/1.1" 204 0
2026-03-25 22:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-25 22:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459
2026-03-25 22:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10a5e25e-516f-5f87-bbbb-30b29f313e8f with identifier: 1982459 to the API
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '10a5e25e-516f-5f87-bbbb-30b29f313e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 119346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10a5e25e-516f-5f87-bbbb-30b29f313e8f/10a5e25e-516f-5f87-bbbb-30b29f313e8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/1ca04215ae6e469caf0e34e3973f2a83/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982459%27 HTTP/1.1" 200 None
2026-03-25 22:50:27 [ayvens.be] INFO: Saving data for 1982459: {'created_time': 1774479027.959642, 'last_price_update_time': 1774479027.959652, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982459') HTTP/1.1" 204 0
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/9.jpg not downloaded yet
2026-03-25 22:50:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236422d0>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/2.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288182d0>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/5.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/10.jpg not downloaded yet
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f5f90>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/1.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [ayvens.be] INFO: Found listing with ID: 1982466
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982466%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [ayvens.be] INFO: Scrape type for 1982466: 1
2026-03-25 22:50:28 [ayvens.be] INFO: Extracting data for car ID: 1982466
2026-03-25 22:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-25 22:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with scrape type 1
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/1.jpg not downloaded yet
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac51d0>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/9.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/2.jpg not downloaded yet
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/3.jpg not downloaded yet
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b4410>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/4.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7850>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/3.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/4.jpg not downloaded yet
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/5.jpg not downloaded yet
2026-03-25 22:50:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/6.jpg not downloaded yet
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6f0d0>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/8.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a07490>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/8.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b0a390>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/7.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a7ecd0>
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/6.jpg saved to cache
2026-03-25 22:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/7.jpg not downloaded yet
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/8.jpg not downloaded yet
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28395010>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/10.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236403d0>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/1.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/9.jpg not downloaded yet
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/10.jpg not downloaded yet
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [ayvens.be] INFO: Found listing with ID: 1982467
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982467%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [ayvens.be] INFO: Scrape type for 1982467: 1
2026-03-25 22:50:29 [ayvens.be] INFO: Extracting data for car ID: 1982467
2026-03-25 22:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-25 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with scrape type 1
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/1.jpg not downloaded yet
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289069d0>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/2.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/2.jpg not downloaded yet
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/3.jpg not downloaded yet
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ff10>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/3.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e41fd0>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/4.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ebdd0>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/5.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503050>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/6.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/4.jpg not downloaded yet
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/5.jpg not downloaded yet
2026-03-25 22:50:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/6.jpg not downloaded yet
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a6990>
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F4d3be79fb8da4a01b990f07d7b3b195a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/9.jpg saved to cache
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69d499af-3843-575a-be0e-d5894765409c
2026-03-25 22:50:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69d499af-3843-575a-be0e-d5894765409c, skipping ID generation
2026-03-25 22:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69d499af-3843-575a-be0e-d5894765409c with scrape type 1
2026-03-25 22:50:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69d499af-3843-575a-be0e-d5894765409c sending to next pipeline
2026-03-25 22:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69d499af-3843-575a-be0e-d5894765409c, identifier: 1982464
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23674190>
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/7.jpg saved to cache
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-25 22:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464
2026-03-25 22:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69d499af-3843-575a-be0e-d5894765409c with identifier: 1982464 to the API
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '69d499af-3843-575a-be0e-d5894765409c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 85456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69d499af-3843-575a-be0e-d5894765409c/69d499af-3843-575a-be0e-d5894765409c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/4d3be79fb8da4a01b990f07d7b3b195a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 VVT-I HEV C-LUB MONO-TONE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 VVT-I HEV C-LUB MONO-TONE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982464%27 HTTP/1.1" 200 None
2026-03-25 22:50:30 [ayvens.be] INFO: Saving data for 1982464: {'created_time': 1774479030.612408, 'last_price_update_time': 1774479030.612419, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982464') HTTP/1.1" 204 0
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/7.jpg not downloaded yet
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/8.jpg not downloaded yet
2026-03-25 22:50:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d7290>
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/8.jpg saved to cache
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4e510>
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/10.jpg saved to cache
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d5b90>
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252Fbe069d5ee07e4c90bf5b1193fa603399%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/9.jpg saved to cache
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f050986b-f470-5a9e-af76-068d8f4cf6e6
2026-03-25 22:50:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f050986b-f470-5a9e-af76-068d8f4cf6e6, skipping ID generation
2026-03-25 22:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f050986b-f470-5a9e-af76-068d8f4cf6e6 with scrape type 1
2026-03-25 22:50:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f050986b-f470-5a9e-af76-068d8f4cf6e6 sending to next pipeline
2026-03-25 22:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f050986b-f470-5a9e-af76-068d8f4cf6e6, identifier: 1982465
2026-03-25 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/9.jpg not downloaded yet
2026-03-25 22:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-25 22:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465
2026-03-25 22:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f050986b-f470-5a9e-af76-068d8f4cf6e6 with identifier: 1982465 to the API
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f050986b-f470-5a9e-af76-068d8f4cf6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 102933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f050986b-f470-5a9e-af76-068d8f4cf6e6/f050986b-f470-5a9e-af76-068d8f4cf6e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/be069d5ee07e4c90bf5b1193fa603399/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 30 TDI 100KW S TR BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR BUSINESS ED',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982465%27 HTTP/1.1" 200 None
2026-03-25 22:50:31 [ayvens.be] INFO: Saving data for 1982465: {'created_time': 1774479031.724177, 'last_price_update_time': 1774479031.724188, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982465') HTTP/1.1" 204 0
2026-03-25 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/10.jpg not downloaded yet
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fd350>
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/3.jpg saved to cache
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:31 [ayvens.be] INFO: Found listing with ID: 1982468
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982468%27 HTTP/1.1" 200 None
2026-03-25 22:50:31 [ayvens.be] INFO: Scrape type for 1982468: 1
2026-03-25 22:50:31 [ayvens.be] INFO: Extracting data for car ID: 1982468
2026-03-25 22:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-25 22:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3a8e03-6d71-5262-919f-fa0570eaa289 with scrape type 1
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/1.jpg not downloaded yet
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9bbd0>
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/2.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/2.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aecd50>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/1.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288149d0>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/2.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6f590>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/3.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/3.jpg not downloaded yet
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/4.jpg not downloaded yet
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215149d0>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/5.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f490>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/7.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/5.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/6.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/7.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/8.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/9.jpg not downloaded yet
2026-03-25 22:50:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/10.jpg not downloaded yet
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9a10>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/8.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28814c50>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/6.jpg saved to cache
2026-03-25 22:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b087d0>
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/10.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:33 [ayvens.be] INFO: Found listing with ID: 1982469
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982469%27 HTTP/1.1" 200 None
2026-03-25 22:50:33 [ayvens.be] INFO: Scrape type for 1982469: 1
2026-03-25 22:50:33 [ayvens.be] INFO: Extracting data for car ID: 1982469
2026-03-25 22:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-25 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf27518d-000f-541f-8175-556aea3c18e6 with scrape type 1
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/1.jpg not downloaded yet
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6f890>
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/9.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/2.jpg not downloaded yet
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/3.jpg not downloaded yet
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890cd50>
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/1.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aeca90>
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/3.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f5550>
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252Fffcdb9962c15424e9ce003a8afad0c6d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/4.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb
2026-03-25 22:50:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb, skipping ID generation
2026-03-25 22:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with scrape type 1
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb sending to next pipeline
2026-03-25 22:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb, identifier: 1982466
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23646550>
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/5.jpg saved to cache
2026-03-25 22:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-25 22:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466
2026-03-25 22:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb with identifier: 1982466 to the API
2026-03-25 22:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 89351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb/3464b5bd-93fc-5dc3-b4fe-0e113f01eeeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/ffcdb9962c15424e9ce003a8afad0c6d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982466%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [ayvens.be] INFO: Saving data for 1982466: {'created_time': 1774479034.142029, 'last_price_update_time': 1774479034.142041, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982466') HTTP/1.1" 204 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/4.jpg not downloaded yet
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/5.jpg not downloaded yet
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/6.jpg not downloaded yet
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/7.jpg not downloaded yet
2026-03-25 22:50:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/8.jpg not downloaded yet
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/9.jpg not downloaded yet
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/10.jpg not downloaded yet
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23669450>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/9.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a362810>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/7.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [ayvens.be] INFO: Found listing with ID: 1982470
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982470%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [ayvens.be] INFO: Scrape type for 1982470: 1
2026-03-25 22:50:34 [ayvens.be] INFO: Extracting data for car ID: 1982470
2026-03-25 22:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-25 22:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d57ab0-6978-5be0-be88-6219e02c2e1b with scrape type 1
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/1.jpg not downloaded yet
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/2.jpg not downloaded yet
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/3.jpg not downloaded yet
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361d590>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/4.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236885d0>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/2.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28764f50>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/6.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa16d0>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/10.jpg saved to cache
2026-03-25 22:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28767690>
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xm%252F9f01269c735942d1b0c19945b58e82e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/8.jpg saved to cache
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae
2026-03-25 22:50:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae, skipping ID generation
2026-03-25 22:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with scrape type 1
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae sending to next pipeline
2026-03-25 22:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae, identifier: 1982467
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c0d90>
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/1.jpg saved to cache
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-25 22:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467
2026-03-25 22:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4159fc8d-9f3b-5a91-8c5a-7df3821f96ae with identifier: 1982467 to the API
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4159fc8d-9f3b-5a91-8c5a-7df3821f96ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 102775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4159fc8d-9f3b-5a91-8c5a-7df3821f96ae/4159fc8d-9f3b-5a91-8c5a-7df3821f96ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xm/9f01269c735942d1b0c19945b58e82e7/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Access (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Access (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982467%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [ayvens.be] INFO: Saving data for 1982467: {'created_time': 1774479035.652814, 'last_price_update_time': 1774479035.652824, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982467') HTTP/1.1" 204 0
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/4.jpg not downloaded yet
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/5.jpg not downloaded yet
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/6.jpg not downloaded yet
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/7.jpg not downloaded yet
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/8.jpg not downloaded yet
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/9.jpg not downloaded yet
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/10.jpg not downloaded yet
2026-03-25 22:50:35 [ayvens.be] INFO: Found listing with ID: 1982471
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982471%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [ayvens.be] INFO: Scrape type for 1982471: 1
2026-03-25 22:50:35 [ayvens.be] INFO: Extracting data for car ID: 1982471
2026-03-25 22:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-25 22:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with scrape type 1
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/1.jpg not downloaded yet
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2366a9d0>
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/3.jpg saved to cache
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/2.jpg not downloaded yet
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b8d50>
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bu%252Fce56088db4df43adbc33f56bd46572e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/1.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a29fd8c7-6c7e-5989-b365-4cc19d106723
2026-03-25 22:50:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29fd8c7-6c7e-5989-b365-4cc19d106723, skipping ID generation
2026-03-25 22:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29fd8c7-6c7e-5989-b365-4cc19d106723 with scrape type 1
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a29fd8c7-6c7e-5989-b365-4cc19d106723 sending to next pipeline
2026-03-25 22:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a29fd8c7-6c7e-5989-b365-4cc19d106723, identifier: 1982182
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901cd90>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/1.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c09d0>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/7.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f73d0>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/2.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ad490>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/5.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23feaad0>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/4.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ac4a90>
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/6.jpg saved to cache
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/3.jpg not downloaded yet
2026-03-25 22:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a29fd8c7-6c7e-5989-b365-4cc19d106723 with identifier: 1982182
2026-03-25 22:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a29fd8c7-6c7e-5989-b365-4cc19d106723 with identifier: 1982182
2026-03-25 22:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a29fd8c7-6c7e-5989-b365-4cc19d106723 with identifier: 1982182 to the API
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a29fd8c7-6c7e-5989-b365-4cc19d106723',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 87431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648314,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29fd8c7-6c7e-5989-b365-4cc19d106723/a29fd8c7-6c7e-5989-b365-4cc19d106723_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bu/ce56088db4df43adbc33f56bd46572e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982182%27 HTTP/1.1" 200 None
2026-03-25 22:50:36 [ayvens.be] INFO: Saving data for 1982182: {'created_time': 1774479036.986919, 'last_price_update_time': 1774479036.986929, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982182') HTTP/1.1" 204 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/4.jpg not downloaded yet
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/5.jpg not downloaded yet
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/6.jpg not downloaded yet
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/7.jpg not downloaded yet
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/8.jpg not downloaded yet
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/9.jpg not downloaded yet
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/10.jpg not downloaded yet
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a96ed0>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/3.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:37 [ayvens.be] INFO: Found listing with ID: 1982472
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982472%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [ayvens.be] INFO: Scrape type for 1982472: 1
2026-03-25 22:50:37 [ayvens.be] INFO: Extracting data for car ID: 1982472
2026-03-25 22:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-25 22:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acd9598-579a-5dde-90fd-00aca329922f with scrape type 1
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/1.jpg not downloaded yet
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/2.jpg not downloaded yet
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/3.jpg not downloaded yet
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1e190>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/4.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aef290>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/1.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215210d0>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/5.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b72d0>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/2.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a645b10>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/10.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a95450>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/9.jpg saved to cache
2026-03-25 22:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21515750>
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F6eff901557f74afab46cd4b8adf37ea1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/8.jpg saved to cache
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b3a8e03-6d71-5262-919f-fa0570eaa289
2026-03-25 22:50:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b3a8e03-6d71-5262-919f-fa0570eaa289, skipping ID generation
2026-03-25 22:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3a8e03-6d71-5262-919f-fa0570eaa289 with scrape type 1
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b3a8e03-6d71-5262-919f-fa0570eaa289 sending to next pipeline
2026-03-25 22:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b3a8e03-6d71-5262-919f-fa0570eaa289, identifier: 1982468
2026-03-25 22:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-25 22:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468
2026-03-25 22:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b3a8e03-6d71-5262-919f-fa0570eaa289 with identifier: 1982468 to the API
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '5b3a8e03-6d71-5262-919f-fa0570eaa289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 82918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3a8e03-6d71-5262-919f-fa0570eaa289/5b3a8e03-6d71-5262-919f-fa0570eaa289_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/6eff901557f74afab46cd4b8adf37ea1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982468%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [ayvens.be] INFO: Saving data for 1982468: {'created_time': 1774479038.503995, 'last_price_update_time': 1774479038.504011, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982468') HTTP/1.1" 204 0
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/4.jpg not downloaded yet
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/5.jpg not downloaded yet
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/6.jpg not downloaded yet
2026-03-25 22:50:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/7.jpg not downloaded yet
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/8.jpg not downloaded yet
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/9.jpg not downloaded yet
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150f290>
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/3.jpg saved to cache
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/10.jpg not downloaded yet
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a7150>
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/5.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7790>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/2.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368f790>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/9.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:39 [ayvens.be] INFO: Found listing with ID: 1982473
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982473%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [ayvens.be] INFO: Scrape type for 1982473: 1
2026-03-25 22:50:39 [ayvens.be] INFO: Extracting data for car ID: 1982473
2026-03-25 22:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-25 22:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70848cdf-9bb6-577a-af2e-41dfa506b339 with scrape type 1
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/1.jpg not downloaded yet
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/2.jpg not downloaded yet
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c10fd0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/4.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287b41d0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/2.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4cd0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/10.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9aa10>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/8.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/3.jpg not downloaded yet
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/4.jpg not downloaded yet
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287649d0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/4.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e42bd0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/3.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/5.jpg not downloaded yet
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/6.jpg not downloaded yet
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/7.jpg not downloaded yet
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a97950>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/4.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924490>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/10.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236493d0>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/5.jpg saved to cache
2026-03-25 22:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21503e10>
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/1.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bcac10>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/3.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad1d0>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/6.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/8.jpg not downloaded yet
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/9.jpg not downloaded yet
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287565d0>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/2.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ac510>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/1.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/10.jpg not downloaded yet
2026-03-25 22:50:40 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f17d0>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/9.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283a8f10>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/10.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ae950>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/7.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283aaad0>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/9.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5f9d0>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/5.jpg saved to cache
2026-03-25 22:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28764d50>
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252Ffb967b8a869841f4b1ce2de930690d13%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/8.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad
2026-03-25 22:50:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad, skipping ID generation
2026-03-25 22:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with scrape type 1
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad sending to next pipeline
2026-03-25 22:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad, identifier: 1982471
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2b341a90>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/10.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2abc3210>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/1.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-25 22:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471
2026-03-25 22:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad with identifier: 1982471 to the API
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': '1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 36446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad/1756c4f5-4977-5b7a-b6d9-1eb44bd4c4ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/fb967b8a869841f4b1ce2de930690d13/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 22 KWH MAXI Z.E. B-BUY 2-SEATS',
 'transmission': 'automatic',
 'trim': '22 KWH MAXI Z.E. B-BUY 2-SEATS',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982471%27 HTTP/1.1" 200 None
2026-03-25 22:50:41 [ayvens.be] INFO: Saving data for 1982471: {'created_time': 1774479041.703581, 'last_price_update_time': 1774479041.70359, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982471') HTTP/1.1" 204 0
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236437d0>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/2.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e8150>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/7.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c11d0>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/6.jpg saved to cache
2026-03-25 22:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28757150>
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/9.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a5390d0>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Ffb8453f96d0e4ecc966b52cde2106857%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/8.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4acd9598-579a-5dde-90fd-00aca329922f
2026-03-25 22:50:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4acd9598-579a-5dde-90fd-00aca329922f, skipping ID generation
2026-03-25 22:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acd9598-579a-5dde-90fd-00aca329922f with scrape type 1
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4acd9598-579a-5dde-90fd-00aca329922f sending to next pipeline
2026-03-25 22:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4acd9598-579a-5dde-90fd-00aca329922f, identifier: 1982472
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214ff290>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/3.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-25 22:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472
2026-03-25 22:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4acd9598-579a-5dde-90fd-00aca329922f with identifier: 1982472 to the API
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '4acd9598-579a-5dde-90fd-00aca329922f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 34186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4acd9598-579a-5dde-90fd-00aca329922f/4acd9598-579a-5dde-90fd-00aca329922f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/fb8453f96d0e4ecc966b52cde2106857/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO 1.0 SCE 65 ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.0 SCE 65 ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982472%27 HTTP/1.1" 200 None
2026-03-25 22:50:42 [ayvens.be] INFO: Saving data for 1982472: {'created_time': 1774479042.575343, 'last_price_update_time': 1774479042.575352, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982472') HTTP/1.1" 204 0
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288a43d0>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/5.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884be90>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/6.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28819d10>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/7.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ff90>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/4.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879b1d0>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/8.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288be650>
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/9.jpg saved to cache
2026-03-25 22:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cea50>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/8.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae4d50>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/7.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a20d10>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bv%252F4432f98abed94510b8fce8f01bedcea1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/10.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70848cdf-9bb6-577a-af2e-41dfa506b339
2026-03-25 22:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70848cdf-9bb6-577a-af2e-41dfa506b339, skipping ID generation
2026-03-25 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70848cdf-9bb6-577a-af2e-41dfa506b339 with scrape type 1
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70848cdf-9bb6-577a-af2e-41dfa506b339 sending to next pipeline
2026-03-25 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70848cdf-9bb6-577a-af2e-41dfa506b339, identifier: 1982473
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ff5d0>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xx%252F25304eec6b3a4692a86d4b51e646c36c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/6.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9d57ab0-6978-5be0-be88-6219e02c2e1b
2026-03-25 22:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9d57ab0-6978-5be0-be88-6219e02c2e1b, skipping ID generation
2026-03-25 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d57ab0-6978-5be0-be88-6219e02c2e1b with scrape type 1
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9d57ab0-6978-5be0-be88-6219e02c2e1b sending to next pipeline
2026-03-25 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9d57ab0-6978-5be0-be88-6219e02c2e1b, identifier: 1982470
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bdc90>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/6.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ed790>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F7bb01946803a4dbe99edd0cd8b600f35%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/7.jpg saved to cache
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf27518d-000f-541f-8175-556aea3c18e6
2026-03-25 22:50:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf27518d-000f-541f-8175-556aea3c18e6, skipping ID generation
2026-03-25 22:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf27518d-000f-541f-8175-556aea3c18e6 with scrape type 1
2026-03-25 22:50:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf27518d-000f-541f-8175-556aea3c18e6 sending to next pipeline
2026-03-25 22:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf27518d-000f-541f-8175-556aea3c18e6, identifier: 1982469
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215123d0>
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/9.jpg saved to cache
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d8dd0>
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/10.jpg saved to cache
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21510210>
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/1.jpg saved to cache
2026-03-25 22:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-25 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473
2026-03-25 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70848cdf-9bb6-577a-af2e-41dfa506b339 with identifier: 1982473 to the API
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '70848cdf-9bb6-577a-af2e-41dfa506b339',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 84182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70848cdf-9bb6-577a-af2e-41dfa506b339/70848cdf-9bb6-577a-af2e-41dfa506b339_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bv/4432f98abed94510b8fce8f01bedcea1/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982473%27 HTTP/1.1" 200 None
2026-03-25 22:50:44 [ayvens.be] INFO: Saving data for 1982473: {'created_time': 1774479044.628852, 'last_price_update_time': 1774479044.628862, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982473') HTTP/1.1" 204 0
2026-03-25 22:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-25 22:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470
2026-03-25 22:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9d57ab0-6978-5be0-be88-6219e02c2e1b with identifier: 1982470 to the API
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd9d57ab0-6978-5be0-be88-6219e02c2e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Clio',
 'odometer': 41062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9d57ab0-6978-5be0-be88-6219e02c2e1b/d9d57ab0-6978-5be0-be88-6219e02c2e1b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xx/25304eec6b3a4692a86d4b51e646c36c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Clio 0.9 TCe Zen (EU6c) STOCK',
 'transmission': 'manual',
 'trim': '0.9 TCe Zen (EU6c) STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982470%27 HTTP/1.1" 200 None
2026-03-25 22:50:45 [ayvens.be] INFO: Saving data for 1982470: {'created_time': 1774479045.002639, 'last_price_update_time': 1774479045.00265, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982470') HTTP/1.1" 204 0
2026-03-25 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-25 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469
2026-03-25 22:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf27518d-000f-541f-8175-556aea3c18e6 with identifier: 1982469 to the API
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cf27518d-000f-541f-8175-556aea3c18e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON - 2020',
 'odometer': 50464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672398,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf27518d-000f-541f-8175-556aea3c18e6/cf27518d-000f-541f-8175-556aea3c18e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/7bb01946803a4dbe99edd0cd8b600f35/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON - 2020 1.0 EcoTSI Move!',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI Move!',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982469%27 HTTP/1.1" 200 None
2026-03-25 22:50:45 [ayvens.be] INFO: Saving data for 1982469: {'created_time': 1774479045.365469, 'last_price_update_time': 1774479045.365479, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982469') HTTP/1.1" 204 0
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28394ed0>
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F5dd2c53f05294a78ba42c68e1e56b153%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/2.jpg saved to cache
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de2debce-b59d-5c3b-9e5b-271302e23a49
2026-03-25 22:50:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de2debce-b59d-5c3b-9e5b-271302e23a49, skipping ID generation
2026-03-25 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de2debce-b59d-5c3b-9e5b-271302e23a49 with scrape type 1
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de2debce-b59d-5c3b-9e5b-271302e23a49 sending to next pipeline
2026-03-25 22:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de2debce-b59d-5c3b-9e5b-271302e23a49, identifier: 1982181
2026-03-25 22:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de2debce-b59d-5c3b-9e5b-271302e23a49 with identifier: 1982181
2026-03-25 22:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de2debce-b59d-5c3b-9e5b-271302e23a49 with identifier: 1982181
2026-03-25 22:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de2debce-b59d-5c3b-9e5b-271302e23a49 with identifier: 1982181 to the API
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de2debce-b59d-5c3b-9e5b-271302e23a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 35109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 810819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de2debce-b59d-5c3b-9e5b-271302e23a49/de2debce-b59d-5c3b-9e5b-271302e23a49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 855963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/5dd2c53f05294a78ba42c68e1e56b153/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982181%27 HTTP/1.1" 200 None
2026-03-25 22:50:45 [ayvens.be] INFO: Saving data for 1982181: {'created_time': 1774479045.862223, 'last_price_update_time': 1774479045.862235, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982181') HTTP/1.1" 204 0
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:45 [ayvens.be] INFO: Found listing with ID: 1982474
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982474%27 HTTP/1.1" 200 None
2026-03-25 22:50:45 [ayvens.be] INFO: Scrape type for 1982474: 1
2026-03-25 22:50:45 [ayvens.be] INFO: Extracting data for car ID: 1982474
2026-03-25 22:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-25 22:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with scrape type 1
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/1.jpg not downloaded yet
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23688790>
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/9.jpg saved to cache
2026-03-25 22:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/2.jpg not downloaded yet
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4dd50>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/1.jpg saved to cache
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23647690>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/9.jpg saved to cache
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289061d0>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/10.jpg saved to cache
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361ff90>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/10.jpg saved to cache
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9a9d0>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fac14f74194124135870b133b3e1a9800%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/8.jpg saved to cache
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7f5c5b0-5552-5777-823e-899eb20accba
2026-03-25 22:50:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7f5c5b0-5552-5777-823e-899eb20accba, skipping ID generation
2026-03-25 22:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f5c5b0-5552-5777-823e-899eb20accba with scrape type 1
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7f5c5b0-5552-5777-823e-899eb20accba sending to next pipeline
2026-03-25 22:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7f5c5b0-5552-5777-823e-899eb20accba, identifier: 1982180
2026-03-25 22:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/3.jpg not downloaded yet
2026-03-25 22:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7f5c5b0-5552-5777-823e-899eb20accba with identifier: 1982180
2026-03-25 22:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7f5c5b0-5552-5777-823e-899eb20accba with identifier: 1982180
2026-03-25 22:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7f5c5b0-5552-5777-823e-899eb20accba with identifier: 1982180 to the API
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7f5c5b0-5552-5777-823e-899eb20accba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 45260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f5c5b0-5552-5777-823e-899eb20accba/b7f5c5b0-5552-5777-823e-899eb20accba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/ac14f74194124135870b133b3e1a9800/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982180%27 HTTP/1.1" 200 None
2026-03-25 22:50:46 [ayvens.be] INFO: Saving data for 1982180: {'created_time': 1774479046.909651, 'last_price_update_time': 1774479046.909661, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982180') HTTP/1.1" 204 0
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/4.jpg not downloaded yet
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d5250>
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/2.jpg saved to cache
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/5.jpg not downloaded yet
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc8a50>
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F8645077f0f4f474c81b6c756993a3c05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/1.jpg saved to cache
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a738c41-be66-5acf-acdb-af80ab5c94e5
2026-03-25 22:50:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a738c41-be66-5acf-acdb-af80ab5c94e5, skipping ID generation
2026-03-25 22:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a738c41-be66-5acf-acdb-af80ab5c94e5 with scrape type 1
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a738c41-be66-5acf-acdb-af80ab5c94e5 sending to next pipeline
2026-03-25 22:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a738c41-be66-5acf-acdb-af80ab5c94e5, identifier: 1982179
2026-03-25 22:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a738c41-be66-5acf-acdb-af80ab5c94e5 with identifier: 1982179
2026-03-25 22:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a738c41-be66-5acf-acdb-af80ab5c94e5 with identifier: 1982179
2026-03-25 22:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a738c41-be66-5acf-acdb-af80ab5c94e5 with identifier: 1982179 to the API
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '9a738c41-be66-5acf-acdb-af80ab5c94e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 31214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a738c41-be66-5acf-acdb-af80ab5c94e5/9a738c41-be66-5acf-acdb-af80ab5c94e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 849335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/8645077f0f4f474c81b6c756993a3c05/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982179%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [ayvens.be] INFO: Saving data for 1982179: {'created_time': 1774479047.527211, 'last_price_update_time': 1774479047.52722, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982179') HTTP/1.1" 204 0
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/6.jpg not downloaded yet
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/7.jpg not downloaded yet
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/8.jpg not downloaded yet
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/9.jpg not downloaded yet
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/10.jpg not downloaded yet
2026-03-25 22:50:47 [ayvens.be] INFO: Found listing with ID: 1982475
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982475%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [ayvens.be] INFO: Scrape type for 1982475: 1
2026-03-25 22:50:47 [ayvens.be] INFO: Extracting data for car ID: 1982475
2026-03-25 22:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-25 22:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822a5572-f966-5eba-ab98-a37b168414f4 with scrape type 1
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/1.jpg not downloaded yet
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/2.jpg not downloaded yet
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0f250>
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/10.jpg saved to cache
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/3.jpg not downloaded yet
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892e990>
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/7.jpg saved to cache
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/4.jpg not downloaded yet
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/5.jpg not downloaded yet
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ced90>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/7.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0e090>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/9.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28817790>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/9.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c2650>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F3e606ed3ef3f45df9eea916b9cc42f77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/8.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfe83458-af49-529e-b76c-e4973bb0a83a
2026-03-25 22:50:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfe83458-af49-529e-b76c-e4973bb0a83a, skipping ID generation
2026-03-25 22:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfe83458-af49-529e-b76c-e4973bb0a83a with scrape type 1
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfe83458-af49-529e-b76c-e4973bb0a83a sending to next pipeline
2026-03-25 22:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dfe83458-af49-529e-b76c-e4973bb0a83a, identifier: 1982177
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a849c50>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/7.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0c250>
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F285cc332136749e4b887df8355c633a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/8.jpg saved to cache
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484
2026-03-25 22:50:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdaec79c-7adf-5007-9e6e-e4d5a40a3484, skipping ID generation
2026-03-25 22:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with scrape type 1
2026-03-25 22:50:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdaec79c-7adf-5007-9e6e-e4d5a40a3484 sending to next pipeline
2026-03-25 22:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fdaec79c-7adf-5007-9e6e-e4d5a40a3484, identifier: 1982178
2026-03-25 22:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dfe83458-af49-529e-b76c-e4973bb0a83a with identifier: 1982177
2026-03-25 22:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dfe83458-af49-529e-b76c-e4973bb0a83a with identifier: 1982177
2026-03-25 22:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dfe83458-af49-529e-b76c-e4973bb0a83a with identifier: 1982177 to the API
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dfe83458-af49-529e-b76c-e4973bb0a83a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 52553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfe83458-af49-529e-b76c-e4973bb0a83a/dfe83458-af49-529e-b76c-e4973bb0a83a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 821388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/3e606ed3ef3f45df9eea916b9cc42f77/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982177%27 HTTP/1.1" 200 None
2026-03-25 22:50:48 [ayvens.be] INFO: Saving data for 1982177: {'created_time': 1774479048.965478, 'last_price_update_time': 1774479048.965488, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982177') HTTP/1.1" 204 0
2026-03-25 22:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with identifier: 1982178
2026-03-25 22:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with identifier: 1982178
2026-03-25 22:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fdaec79c-7adf-5007-9e6e-e4d5a40a3484 with identifier: 1982178 to the API
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fdaec79c-7adf-5007-9e6e-e4d5a40a3484',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdaec79c-7adf-5007-9e6e-e4d5a40a3484/fdaec79c-7adf-5007-9e6e-e4d5a40a3484_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/285cc332136749e4b887df8355c633a9/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982178%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [ayvens.be] INFO: Saving data for 1982178: {'created_time': 1774479049.375116, 'last_price_update_time': 1774479049.375126, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982178') HTTP/1.1" 204 0
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/6.jpg not downloaded yet
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/7.jpg not downloaded yet
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/8.jpg not downloaded yet
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/9.jpg not downloaded yet
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/10.jpg not downloaded yet
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:49 [ayvens.be] INFO: Found listing with ID: 1982476
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982476%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [ayvens.be] INFO: Scrape type for 1982476: 1
2026-03-25 22:50:49 [ayvens.be] INFO: Extracting data for car ID: 1982476
2026-03-25 22:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-25 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with scrape type 1
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/1.jpg not downloaded yet
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fee10>
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/2.jpg saved to cache
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/2.jpg not downloaded yet
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214feb10>
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/3.jpg saved to cache
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/3.jpg not downloaded yet
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/4.jpg not downloaded yet
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0d390>
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F2393db96f97343a1924e33496480468a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/8.jpg saved to cache
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c3b026f-df37-5e78-bea5-d891cc71bb04
2026-03-25 22:50:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c3b026f-df37-5e78-bea5-d891cc71bb04, skipping ID generation
2026-03-25 22:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3b026f-df37-5e78-bea5-d891cc71bb04 with scrape type 1
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c3b026f-df37-5e78-bea5-d891cc71bb04 sending to next pipeline
2026-03-25 22:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c3b026f-df37-5e78-bea5-d891cc71bb04, identifier: 1982172
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ea090>
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/7.jpg saved to cache
2026-03-25 22:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883e550>
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F22385c2332774c4da85ec19aa3c0a82a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/6.jpg saved to cache
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f
2026-03-25 22:50:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f, skipping ID generation
2026-03-25 22:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with scrape type 1
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f sending to next pipeline
2026-03-25 22:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f, identifier: 1982176
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d72d0>
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb5bc9176e90449eaadc56e340707f22b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/10.jpg saved to cache
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9235a2ca-21a3-55b3-8c79-28af6742234a
2026-03-25 22:50:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9235a2ca-21a3-55b3-8c79-28af6742234a, skipping ID generation
2026-03-25 22:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235a2ca-21a3-55b3-8c79-28af6742234a with scrape type 1
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9235a2ca-21a3-55b3-8c79-28af6742234a sending to next pipeline
2026-03-25 22:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9235a2ca-21a3-55b3-8c79-28af6742234a, identifier: 1982174
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c13fd0>
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/9.jpg saved to cache
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883dad0>
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/8.jpg saved to cache
2026-03-25 22:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:50:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c3b026f-df37-5e78-bea5-d891cc71bb04 with identifier: 1982172
2026-03-25 22:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c3b026f-df37-5e78-bea5-d891cc71bb04 with identifier: 1982172
2026-03-25 22:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c3b026f-df37-5e78-bea5-d891cc71bb04 with identifier: 1982172 to the API
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '3c3b026f-df37-5e78-bea5-d891cc71bb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 75967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c3b026f-df37-5e78-bea5-d891cc71bb04/3c3b026f-df37-5e78-bea5-d891cc71bb04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/2393db96f97343a1924e33496480468a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982172%27 HTTP/1.1" 200 None
2026-03-25 22:50:50 [ayvens.be] INFO: Saving data for 1982172: {'created_time': 1774479050.877992, 'last_price_update_time': 1774479050.878001, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982172') HTTP/1.1" 204 0
2026-03-25 22:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with identifier: 1982176
2026-03-25 22:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with identifier: 1982176
2026-03-25 22:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0a2a2825-4f80-5bfd-ad29-c3de1c7f902f with identifier: 1982176 to the API
2026-03-25 22:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a2a2825-4f80-5bfd-ad29-c3de1c7f902f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 39500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 843704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a2a2825-4f80-5bfd-ad29-c3de1c7f902f/0a2a2825-4f80-5bfd-ad29-c3de1c7f902f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/22385c2332774c4da85ec19aa3c0a82a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982176%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [ayvens.be] INFO: Saving data for 1982176: {'created_time': 1774479051.172865, 'last_price_update_time': 1774479051.172876, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982176') HTTP/1.1" 204 0
2026-03-25 22:50:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9235a2ca-21a3-55b3-8c79-28af6742234a with identifier: 1982174
2026-03-25 22:50:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9235a2ca-21a3-55b3-8c79-28af6742234a with identifier: 1982174
2026-03-25 22:50:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9235a2ca-21a3-55b3-8c79-28af6742234a with identifier: 1982174 to the API
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '9235a2ca-21a3-55b3-8c79-28af6742234a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 83262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664457,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 944414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9235a2ca-21a3-55b3-8c79-28af6742234a/9235a2ca-21a3-55b3-8c79-28af6742234a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 956628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b5bc9176e90449eaadc56e340707f22b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982174%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [ayvens.be] INFO: Saving data for 1982174: {'created_time': 1774479051.475353, 'last_price_update_time': 1774479051.475362, 'auction_closing_time': 1775037600.0}
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982174') HTTP/1.1" 204 0
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/5.jpg not downloaded yet
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/6.jpg not downloaded yet
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b6f10>
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/5.jpg saved to cache
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/7.jpg not downloaded yet
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/8.jpg not downloaded yet
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/9.jpg not downloaded yet
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/10.jpg not downloaded yet
2026-03-25 22:50:51 [ayvens.be] INFO: Found listing with ID: 1982477
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982477%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [ayvens.be] INFO: Scrape type for 1982477: 1
2026-03-25 22:50:51 [ayvens.be] INFO: Extracting data for car ID: 1982477
2026-03-25 22:50:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-25 22:50:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2da3de6-8252-5e2c-9288-b1863a165294 with scrape type 1
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/1.jpg not downloaded yet
2026-03-25 22:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/2.jpg not downloaded yet
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/3.jpg not downloaded yet
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2878ad90>
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/7.jpg saved to cache
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28915c90>
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/6.jpg saved to cache
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/4.jpg not downloaded yet
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2874b510>
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/4.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28924950>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/3.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7dd0>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/2.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23612450>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/1.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/5.jpg not downloaded yet
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287928d0>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/8.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28aa0c50>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/6.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/6.jpg not downloaded yet
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/7.jpg not downloaded yet
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/8.jpg not downloaded yet
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/9.jpg not downloaded yet
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/10.jpg not downloaded yet
2026-03-25 22:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:52 [ayvens.be] INFO: Found listing with ID: 1982478
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982478%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [ayvens.be] INFO: Scrape type for 1982478: 1
2026-03-25 22:50:52 [ayvens.be] INFO: Extracting data for car ID: 1982478
2026-03-25 22:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-25 22:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db920fb1-a153-5f8c-bed7-0266b14ec159 with scrape type 1
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/1.jpg not downloaded yet
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28743850>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/7.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/2.jpg not downloaded yet
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21521ad0>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/5.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4e910>
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/9.jpg saved to cache
2026-03-25 22:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/3.jpg not downloaded yet
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/4.jpg not downloaded yet
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f4a10>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/4.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bec90>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/8.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b86d0>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/3.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f6690>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/2.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c11cd0>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/10.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/5.jpg not downloaded yet
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/6.jpg not downloaded yet
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/7.jpg not downloaded yet
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/8.jpg not downloaded yet
2026-03-25 22:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/9.jpg not downloaded yet
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/10.jpg not downloaded yet
2026-03-25 22:50:53 [ayvens.be] INFO: Found listing with ID: 1982479
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982479%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [ayvens.be] INFO: Scrape type for 1982479: 1
2026-03-25 22:50:53 [ayvens.be] INFO: Extracting data for car ID: 1982479
2026-03-25 22:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-25 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with scrape type 1
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/1.jpg not downloaded yet
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288f5b10>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/6.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d46d0>
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F8268d307e700415ea37b14ad69d87c78%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/10.jpg saved to cache
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 822a5572-f966-5eba-ab98-a37b168414f4
2026-03-25 22:50:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 822a5572-f966-5eba-ab98-a37b168414f4, skipping ID generation
2026-03-25 22:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822a5572-f966-5eba-ab98-a37b168414f4 with scrape type 1
2026-03-25 22:50:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 822a5572-f966-5eba-ab98-a37b168414f4 sending to next pipeline
2026-03-25 22:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 822a5572-f966-5eba-ab98-a37b168414f4, identifier: 1982475
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288cab10>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/5.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/2.jpg not downloaded yet
2026-03-25 22:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-25 22:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475
2026-03-25 22:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 822a5572-f966-5eba-ab98-a37b168414f4 with identifier: 1982475 to the API
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '822a5572-f966-5eba-ab98-a37b168414f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 22943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_822a5572-f966-5eba-ab98-a37b168414f4/822a5572-f966-5eba-ab98-a37b168414f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/8268d307e700415ea37b14ad69d87c78/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2023}
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982475%27 HTTP/1.1" 200 None
2026-03-25 22:50:54 [ayvens.be] INFO: Saving data for 1982475: {'created_time': 1774479054.434738, 'last_price_update_time': 1774479054.434749, 'auction_closing_time': 1774942200.0}
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982475') HTTP/1.1" 204 0
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d4ad0>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/1.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/3.jpg not downloaded yet
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/4.jpg not downloaded yet
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b38067e50>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/7.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363e250>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/3.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5e990>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/2.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2363d350>
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/9.jpg saved to cache
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/5.jpg not downloaded yet
2026-03-25 22:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/6.jpg not downloaded yet
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/7.jpg not downloaded yet
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/8.jpg not downloaded yet
2026-03-25 22:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/9.jpg not downloaded yet
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/10.jpg not downloaded yet
2026-03-25 22:50:55 [ayvens.be] INFO: Found listing with ID: 1982480
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982480%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [ayvens.be] INFO: Scrape type for 1982480: 1
2026-03-25 22:50:55 [ayvens.be] INFO: Extracting data for car ID: 1982480
2026-03-25 22:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-25 22:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with scrape type 1
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/1.jpg not downloaded yet
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/2.jpg not downloaded yet
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c13750>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/4.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28799f10>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/10.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e22d0>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/6.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ad810>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/7.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288e1290>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/5.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368a710>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/3.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/3.jpg not downloaded yet
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a3946d0>
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/1.jpg saved to cache
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/4.jpg not downloaded yet
2026-03-25 22:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/5.jpg not downloaded yet
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150fb10>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/8.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/6.jpg not downloaded yet
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/7.jpg not downloaded yet
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/8.jpg not downloaded yet
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/9.jpg not downloaded yet
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/10.jpg not downloaded yet
2026-03-25 22:50:56 [ayvens.be] INFO: Found listing with ID: 1982481
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982481%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [ayvens.be] INFO: Scrape type for 1982481: 1
2026-03-25 22:50:56 [ayvens.be] INFO: Extracting data for car ID: 1982481
2026-03-25 22:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-25 22:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bf2da9-d57b-5482-9535-88f20e321d95 with scrape type 1
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/1.jpg not downloaded yet
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/2.jpg not downloaded yet
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21520b50>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/1.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2884b0d0>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/5.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/3.jpg not downloaded yet
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890de10>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/7.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c9f50>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/2.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b7a90>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/6.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/4.jpg not downloaded yet
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/5.jpg not downloaded yet
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741cd0>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/10.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a22910>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/4.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361ec50>
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/2.jpg saved to cache
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/6.jpg not downloaded yet
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/7.jpg not downloaded yet
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/8.jpg not downloaded yet
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/9.jpg not downloaded yet
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/10.jpg not downloaded yet
2026-03-25 22:50:57 [ayvens.be] INFO: Found listing with ID: 1982482
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982482%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [ayvens.be] INFO: Scrape type for 1982482: 1
2026-03-25 22:50:57 [ayvens.be] INFO: Extracting data for car ID: 1982482
2026-03-25 22:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-25 22:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac11435-3641-5dd8-8bbb-437cd16362c1 with scrape type 1
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/1.jpg not downloaded yet
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e1690>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/4.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/2.jpg not downloaded yet
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815f90>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/3.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0f1d0>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/3.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ea210>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/1.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215125d0>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/6.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4c550>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/7.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb73d0>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/5.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21501190>
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/10.jpg saved to cache
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/3.jpg not downloaded yet
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/4.jpg not downloaded yet
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/5.jpg not downloaded yet
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/6.jpg not downloaded yet
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/7.jpg not downloaded yet
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/8.jpg not downloaded yet
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/9.jpg not downloaded yet
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2152b210>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/6.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/10.jpg not downloaded yet
2026-03-25 22:50:58 [ayvens.be] INFO: Found listing with ID: 1982483
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982483%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [ayvens.be] INFO: Scrape type for 1982483: 1
2026-03-25 22:50:58 [ayvens.be] INFO: Extracting data for car ID: 1982483
2026-03-25 22:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-25 22:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dbdacc-f85e-50cd-a562-5120a4c43a46 with scrape type 1
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/1.jpg not downloaded yet
2026-03-25 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/2.jpg not downloaded yet
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7d50>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/2.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b9c10>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/4.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a394bd0>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/5.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364ab10>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/7.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289d7ed0>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/3.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288db510>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/1.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b38064e10>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/2.jpg saved to cache
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/3.jpg not downloaded yet
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/4.jpg not downloaded yet
2026-03-25 22:50:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287dbd90>
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/5.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236e9150>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/10.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/5.jpg not downloaded yet
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/6.jpg not downloaded yet
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/7.jpg not downloaded yet
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2b3c9010>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/9.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2362d510>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/6.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/8.jpg not downloaded yet
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/9.jpg not downloaded yet
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fe8310>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/4.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2369e7d0>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/10.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236af750>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/2.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b0110>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/1.jpg saved to cache
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/10.jpg not downloaded yet
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [ayvens.be] INFO: Found listing with ID: 1982484
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982484%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [ayvens.be] INFO: Scrape type for 1982484: 1
2026-03-25 22:50:59 [ayvens.be] INFO: Extracting data for car ID: 1982484
2026-03-25 22:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-25 22:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8011ce-f24b-5963-afee-68f9cd31adf2 with scrape type 1
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/1.jpg not downloaded yet
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/2.jpg not downloaded yet
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc6c10>
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:50:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:50:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/9.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/3.jpg not downloaded yet
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/4.jpg not downloaded yet
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287664d0>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/4.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c86d0>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/3.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb5410>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/8.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28d0f310>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/6.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926510>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/5.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/5.jpg not downloaded yet
2026-03-25 22:51:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/6.jpg not downloaded yet
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/7.jpg not downloaded yet
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28926ed0>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/7.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880b650>
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F81370de748c8478caa50d266a1ebd872%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/8.jpg saved to cache
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8bf2da9-d57b-5482-9535-88f20e321d95
2026-03-25 22:51:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8bf2da9-d57b-5482-9535-88f20e321d95, skipping ID generation
2026-03-25 22:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8bf2da9-d57b-5482-9535-88f20e321d95 with scrape type 1
2026-03-25 22:51:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8bf2da9-d57b-5482-9535-88f20e321d95 sending to next pipeline
2026-03-25 22:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8bf2da9-d57b-5482-9535-88f20e321d95, identifier: 1982481
2026-03-25 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-25 22:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481
2026-03-25 22:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8bf2da9-d57b-5482-9535-88f20e321d95 with identifier: 1982481 to the API
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a8bf2da9-d57b-5482-9535-88f20e321d95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 22368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8bf2da9-d57b-5482-9535-88f20e321d95/a8bf2da9-d57b-5482-9535-88f20e321d95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/81370de748c8478caa50d266a1ebd872/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE 2.0 GLC 300 DE PHEV 4MATIC BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982481%27 HTTP/1.1" 200 None
2026-03-25 22:51:01 [ayvens.be] INFO: Saving data for 1982481: {'created_time': 1774479061.684657, 'last_price_update_time': 1774479061.684669, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982481') HTTP/1.1" 204 0
2026-03-25 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/8.jpg not downloaded yet
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/9.jpg not downloaded yet
2026-03-25 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23642d90>
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/1.jpg saved to cache
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287c1290>
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/10.jpg saved to cache
2026-03-25 22:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/10.jpg not downloaded yet
2026-03-25 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:02 [ayvens.be] INFO: Found listing with ID: 1982485
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982485%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [ayvens.be] INFO: Scrape type for 1982485: 1
2026-03-25 22:51:02 [ayvens.be] INFO: Extracting data for car ID: 1982485
2026-03-25 22:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-25 22:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbfa6165-acd1-580f-ae41-fda323df94f1 with scrape type 1
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/1.jpg not downloaded yet
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a52ed0>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/3.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28809790>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/7.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/2.jpg not downloaded yet
2026-03-25 22:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/3.jpg not downloaded yet
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23648190>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/2.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b6310>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/9.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288b3310>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/4.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6fe90>
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F5a372425548d4af98d810c7b9de391b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/8.jpg saved to cache
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ac11435-3641-5dd8-8bbb-437cd16362c1
2026-03-25 22:51:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ac11435-3641-5dd8-8bbb-437cd16362c1, skipping ID generation
2026-03-25 22:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac11435-3641-5dd8-8bbb-437cd16362c1 with scrape type 1
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ac11435-3641-5dd8-8bbb-437cd16362c1 sending to next pipeline
2026-03-25 22:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ac11435-3641-5dd8-8bbb-437cd16362c1, identifier: 1982482
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/4.jpg not downloaded yet
2026-03-25 22:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-25 22:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482
2026-03-25 22:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ac11435-3641-5dd8-8bbb-437cd16362c1 with identifier: 1982482 to the API
2026-03-25 22:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9ac11435-3641-5dd8-8bbb-437cd16362c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 62148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac11435-3641-5dd8-8bbb-437cd16362c1/9ac11435-3641-5dd8-8bbb-437cd16362c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/5a372425548d4af98d810c7b9de391b6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982482%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [ayvens.be] INFO: Saving data for 1982482: {'created_time': 1774479063.164172, 'last_price_update_time': 1774479063.164183, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982482') HTTP/1.1" 204 0
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/5.jpg not downloaded yet
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/6.jpg not downloaded yet
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a35efd0>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/7.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/7.jpg not downloaded yet
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/8.jpg not downloaded yet
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a23750>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/10.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1ac10>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/9.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28808a90>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/1.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/9.jpg not downloaded yet
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/10.jpg not downloaded yet
2026-03-25 22:51:03 [ayvens.be] INFO: Found listing with ID: 1982486
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982486%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [ayvens.be] INFO: Scrape type for 1982486: 1
2026-03-25 22:51:03 [ayvens.be] INFO: Extracting data for car ID: 1982486
2026-03-25 22:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-25 22:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with scrape type 1
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/1.jpg not downloaded yet
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28395450>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/8.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae6e90>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/2.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fed90>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/4.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ad390>
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/6.jpg saved to cache
2026-03-25 22:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/2.jpg not downloaded yet
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/3.jpg not downloaded yet
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883d550>
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F0d5ef9d053e544da954d2963178b8f47%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/5.jpg saved to cache
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6dbdacc-f85e-50cd-a562-5120a4c43a46
2026-03-25 22:51:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6dbdacc-f85e-50cd-a562-5120a4c43a46, skipping ID generation
2026-03-25 22:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dbdacc-f85e-50cd-a562-5120a4c43a46 with scrape type 1
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6dbdacc-f85e-50cd-a562-5120a4c43a46 sending to next pipeline
2026-03-25 22:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6dbdacc-f85e-50cd-a562-5120a4c43a46, identifier: 1982483
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/4.jpg not downloaded yet
2026-03-25 22:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-25 22:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483
2026-03-25 22:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6dbdacc-f85e-50cd-a562-5120a4c43a46 with identifier: 1982483 to the API
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b6dbdacc-f85e-50cd-a562-5120a4c43a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 39848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6dbdacc-f85e-50cd-a562-5120a4c43a46/b6dbdacc-f85e-50cd-a562-5120a4c43a46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/0d5ef9d053e544da954d2963178b8f47/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 160',
 'transmission': 'manual',
 'trim': '1.3 A 160',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982483%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [ayvens.be] INFO: Saving data for 1982483: {'created_time': 1774479064.573467, 'last_price_update_time': 1774479064.573476, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982483') HTTP/1.1" 204 0
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/5.jpg not downloaded yet
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883c9d0>
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/7.jpg saved to cache
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c12bd0>
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/6.jpg saved to cache
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/6.jpg not downloaded yet
2026-03-25 22:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/7.jpg not downloaded yet
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28936d90>
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/3.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a84a8d0>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/5.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb7910>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/1.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/8.jpg not downloaded yet
2026-03-25 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/9.jpg not downloaded yet
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2361f990>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/8.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bd050>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/9.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/10.jpg not downloaded yet
2026-03-25 22:51:05 [ayvens.be] INFO: Found listing with ID: 1982487
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982487%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [ayvens.be] INFO: Scrape type for 1982487: 1
2026-03-25 22:51:05 [ayvens.be] INFO: Extracting data for car ID: 1982487
2026-03-25 22:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-25 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62e9ba0-5996-579d-91b8-041173683520 with scrape type 1
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/1.jpg not downloaded yet
2026-03-25 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/2.jpg not downloaded yet
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2880b650>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/3.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a356fd0>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/4.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bf010>
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F60f0827d8d2940768c3a08b8a2e13620%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/10.jpg saved to cache
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa8011ce-f24b-5963-afee-68f9cd31adf2
2026-03-25 22:51:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa8011ce-f24b-5963-afee-68f9cd31adf2, skipping ID generation
2026-03-25 22:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8011ce-f24b-5963-afee-68f9cd31adf2 with scrape type 1
2026-03-25 22:51:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa8011ce-f24b-5963-afee-68f9cd31adf2 sending to next pipeline
2026-03-25 22:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa8011ce-f24b-5963-afee-68f9cd31adf2, identifier: 1982484
2026-03-25 22:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-25 22:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484
2026-03-25 22:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa8011ce-f24b-5963-afee-68f9cd31adf2 with identifier: 1982484 to the API
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fa8011ce-f24b-5963-afee-68f9cd31adf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AYGO X',
 'odometer': 41091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 926410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8011ce-f24b-5963-afee-68f9cd31adf2/fa8011ce-f24b-5963-afee-68f9cd31adf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 972529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/60f0827d8d2940768c3a08b8a2e13620/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA AYGO X 1.0 VVT-I ENVY CVT',
 'transmission': 'automatic',
 'trim': '1.0 VVT-I ENVY CVT',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982484%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [ayvens.be] INFO: Saving data for 1982484: {'created_time': 1774479066.301031, 'last_price_update_time': 1774479066.30104, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982484') HTTP/1.1" 204 0
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/3.jpg not downloaded yet
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/4.jpg not downloaded yet
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883ff10>
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/2.jpg saved to cache
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287882d0>
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/5.jpg saved to cache
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/5.jpg not downloaded yet
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/6.jpg not downloaded yet
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28749710>
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/7.jpg saved to cache
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289e3650>
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/6.jpg saved to cache
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 2 pages/min), scraped 192 items (at 40 items/min)
2026-03-25 22:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/7.jpg not downloaded yet
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/8.jpg not downloaded yet
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b47d0>
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252Fb7f0b40b110d44d494895576d374706c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/1.jpg saved to cache
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28
2026-03-25 22:51:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28f3ba22-fc31-567a-bd91-ccdafe78aa28, skipping ID generation
2026-03-25 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with scrape type 1
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28f3ba22-fc31-567a-bd91-ccdafe78aa28 sending to next pipeline
2026-03-25 22:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28f3ba22-fc31-567a-bd91-ccdafe78aa28, identifier: 1982480
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ac090>
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/1.jpg saved to cache
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/9.jpg not downloaded yet
2026-03-25 22:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-25 22:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480
2026-03-25 22:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28f3ba22-fc31-567a-bd91-ccdafe78aa28 with identifier: 1982480 to the API
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '28f3ba22-fc31-567a-bd91-ccdafe78aa28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 55872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 442762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f3ba22-fc31-567a-bd91-ccdafe78aa28/28f3ba22-fc31-567a-bd91-ccdafe78aa28_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/b7f0b40b110d44d494895576d374706c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85KW MOVE DCT',
 'transmission': 'automatic',
 'trim': '1.0 TSI 85KW MOVE DCT',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982480%27 HTTP/1.1" 200 None
2026-03-25 22:51:07 [ayvens.be] INFO: Saving data for 1982480: {'created_time': 1774479067.58787, 'last_price_update_time': 1774479067.587887, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982480') HTTP/1.1" 204 0
2026-03-25 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/10.jpg not downloaded yet
2026-03-25 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:07 [ayvens.be] INFO: Found listing with ID: 1982488
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982488%27 HTTP/1.1" 200 None
2026-03-25 22:51:07 [ayvens.be] INFO: Scrape type for 1982488: 1
2026-03-25 22:51:07 [ayvens.be] INFO: Extracting data for car ID: 1982488
2026-03-25 22:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-25 22:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fea91da-b641-54fd-a480-3402c5b0b66c with scrape type 1
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/1.jpg not downloaded yet
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a195d0>
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/8.jpg saved to cache
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892ea10>
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/3.jpg saved to cache
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28c11a90>
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/4.jpg saved to cache
2026-03-25 22:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae7050>
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/5.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/2.jpg not downloaded yet
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/3.jpg not downloaded yet
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236c9fd0>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/2.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fb4cd0>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/10.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288af410>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/6.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288ad7d0>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/7.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/4.jpg not downloaded yet
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/5.jpg not downloaded yet
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/6.jpg not downloaded yet
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236d7190>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/8.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/7.jpg not downloaded yet
2026-03-25 22:51:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/8.jpg not downloaded yet
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8d90>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/1.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ec450>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252Fc178de715f214b2b82d2d11083fb8cdb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/9.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbfa6165-acd1-580f-ae41-fda323df94f1
2026-03-25 22:51:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbfa6165-acd1-580f-ae41-fda323df94f1, skipping ID generation
2026-03-25 22:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbfa6165-acd1-580f-ae41-fda323df94f1 with scrape type 1
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbfa6165-acd1-580f-ae41-fda323df94f1 sending to next pipeline
2026-03-25 22:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cbfa6165-acd1-580f-ae41-fda323df94f1, identifier: 1982485
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150dfd0>
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/10.jpg saved to cache
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/9.jpg not downloaded yet
2026-03-25 22:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-25 22:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485
2026-03-25 22:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cbfa6165-acd1-580f-ae41-fda323df94f1 with identifier: 1982485 to the API
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cbfa6165-acd1-580f-ae41-fda323df94f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 74273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 772428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 888634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbfa6165-acd1-580f-ae41-fda323df94f1/cbfa6165-acd1-580f-ae41-fda323df94f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 994996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/c178de715f214b2b82d2d11083fb8cdb/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA 1.2 TURBO 96KW ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 96KW ELEGANCE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982485%27 HTTP/1.1" 200 None
2026-03-25 22:51:09 [ayvens.be] INFO: Saving data for 1982485: {'created_time': 1774479069.275006, 'last_price_update_time': 1774479069.275015, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982485') HTTP/1.1" 204 0
2026-03-25 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/10.jpg not downloaded yet
2026-03-25 22:51:09 [ayvens.be] INFO: Found listing with ID: 1982489
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982489%27 HTTP/1.1" 200 None
2026-03-25 22:51:09 [ayvens.be] INFO: Scrape type for 1982489: 1
2026-03-25 22:51:09 [ayvens.be] INFO: Extracting data for car ID: 1982489
2026-03-25 22:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-25 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab with scrape type 1
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/1.jpg not downloaded yet
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2b341a90>
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/2.jpg saved to cache
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1c890>
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252Ff03c32f1ab91471cb71415d1a4b92b77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/9.jpg saved to cache
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4
2026-03-25 22:51:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4, skipping ID generation
2026-03-25 22:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with scrape type 1
2026-03-25 22:51:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 sending to next pipeline
2026-03-25 22:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4, identifier: 1982486
2026-03-25 22:51:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-25 22:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486
2026-03-25 22:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5d617911-5e07-59ab-b6ff-ec22f5b28cb4 with identifier: 1982486 to the API
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5d617911-5e07-59ab-b6ff-ec22f5b28cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 74857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d617911-5e07-59ab-b6ff-ec22f5b28cb4/5d617911-5e07-59ab-b6ff-ec22f5b28cb4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/f03c32f1ab91471cb71415d1a4b92b77/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.6 PHEV 225 E-AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982486%27 HTTP/1.1" 200 None
2026-03-25 22:51:09 [ayvens.be] INFO: Saving data for 1982486: {'created_time': 1774479069.966618, 'last_price_update_time': 1774479069.966627, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982486') HTTP/1.1" 204 0
2026-03-25 22:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/2.jpg not downloaded yet
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/3.jpg not downloaded yet
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236edc50>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/3.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28757ed0>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/4.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a1b150>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/1.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/4.jpg not downloaded yet
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/5.jpg not downloaded yet
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ac190>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/5.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150a610>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/10.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/6.jpg not downloaded yet
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/7.jpg not downloaded yet
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c0510>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/7.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2b052f10>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/6.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/8.jpg not downloaded yet
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/9.jpg not downloaded yet
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/10.jpg not downloaded yet
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2879b6d0>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/8.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28916290>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/2.jpg saved to cache
2026-03-25 22:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2151b710>
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/9.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28915c50>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bs%252F4972444163d24e9a9dd7a6e370d7cdd6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/10.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d62e9ba0-5996-579d-91b8-041173683520
2026-03-25 22:51:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d62e9ba0-5996-579d-91b8-041173683520, skipping ID generation
2026-03-25 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62e9ba0-5996-579d-91b8-041173683520 with scrape type 1
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d62e9ba0-5996-579d-91b8-041173683520 sending to next pipeline
2026-03-25 22:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d62e9ba0-5996-579d-91b8-041173683520, identifier: 1982487
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b1d350>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/5.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c3e90>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/4.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28af8e50>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/3.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-25 22:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487
2026-03-25 22:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d62e9ba0-5996-579d-91b8-041173683520 with identifier: 1982487 to the API
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd62e9ba0-5996-579d-91b8-041173683520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 78007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d62e9ba0-5996-579d-91b8-041173683520/d62e9ba0-5996-579d-91b8-041173683520_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748271,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bs/4972444163d24e9a9dd7a6e370d7cdd6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982487%27 HTTP/1.1" 200 None
2026-03-25 22:51:11 [ayvens.be] INFO: Saving data for 1982487: {'created_time': 1774479071.778296, 'last_price_update_time': 1774479071.778305, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982487') HTTP/1.1" 204 0
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [ayvens.be] INFO: Found listing with ID: 1982490
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982490%27 HTTP/1.1" 200 None
2026-03-25 22:51:11 [ayvens.be] INFO: Scrape type for 1982490: 1
2026-03-25 22:51:11 [ayvens.be] INFO: Extracting data for car ID: 1982490
2026-03-25 22:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-25 22:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf27002-f671-51e6-901d-6803e65eed45 with scrape type 1
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/1.jpg not downloaded yet
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/2.jpg not downloaded yet
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236fa6d0>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/6.jpg saved to cache
2026-03-25 22:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236891d0>
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/8.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/3.jpg not downloaded yet
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/4.jpg not downloaded yet
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a69050>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/2.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0f050>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/7.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a0c650>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/3.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a394e50>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/1.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/5.jpg not downloaded yet
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/6.jpg not downloaded yet
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a50cd0>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/10.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b214fc910>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/9.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/7.jpg not downloaded yet
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/8.jpg not downloaded yet
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/9.jpg not downloaded yet
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b6ebd0>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/5.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236469d0>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/4.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5ddd0>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/6.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23645010>
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252Fb1b792fbbc154f75a861c88dbe29ec6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/9.jpg saved to cache
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fea91da-b641-54fd-a480-3402c5b0b66c
2026-03-25 22:51:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fea91da-b641-54fd-a480-3402c5b0b66c, skipping ID generation
2026-03-25 22:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fea91da-b641-54fd-a480-3402c5b0b66c with scrape type 1
2026-03-25 22:51:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fea91da-b641-54fd-a480-3402c5b0b66c sending to next pipeline
2026-03-25 22:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5fea91da-b641-54fd-a480-3402c5b0b66c, identifier: 1982488
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-25 22:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488
2026-03-25 22:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5fea91da-b641-54fd-a480-3402c5b0b66c with identifier: 1982488 to the API
2026-03-25 22:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '5fea91da-b641-54fd-a480-3402c5b0b66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 62614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fea91da-b641-54fd-a480-3402c5b0b66c/5fea91da-b641-54fd-a480-3402c5b0b66c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/b1b792fbbc154f75a861c88dbe29ec6b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982488%27 HTTP/1.1" 200 None
2026-03-25 22:51:13 [ayvens.be] INFO: Saving data for 1982488: {'created_time': 1774479073.249275, 'last_price_update_time': 1774479073.249285, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982488') HTTP/1.1" 204 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/10.jpg not downloaded yet
2026-03-25 22:51:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21520c90>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/10.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28e43490>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/7.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a19d50>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/9.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:13 [ayvens.be] INFO: Found listing with ID: 1982491
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982491%27 HTTP/1.1" 200 None
2026-03-25 22:51:13 [ayvens.be] INFO: Scrape type for 1982491: 1
2026-03-25 22:51:13 [ayvens.be] INFO: Extracting data for car ID: 1982491
2026-03-25 22:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-25 22:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07c39a8-9736-55b4-97cd-35de75f7655a with scrape type 1
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/1.jpg not downloaded yet
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a539d0>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/9.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8b50>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ac%252F3da756e9c15346fd84d166d9c95020e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/8.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db920fb1-a153-5f8c-bed7-0266b14ec159
2026-03-25 22:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db920fb1-a153-5f8c-bed7-0266b14ec159, skipping ID generation
2026-03-25 22:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db920fb1-a153-5f8c-bed7-0266b14ec159 with scrape type 1
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db920fb1-a153-5f8c-bed7-0266b14ec159 sending to next pipeline
2026-03-25 22:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db920fb1-a153-5f8c-bed7-0266b14ec159, identifier: 1982478
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a509d0>
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2er%252Fc9f250a5cc2f467287965f2feba21665%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/8.jpg saved to cache
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab
2026-03-25 22:51:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 851522a4-7560-5ec5-8de2-a7e8f4c139ab, skipping ID generation
2026-03-25 22:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab with scrape type 1
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 851522a4-7560-5ec5-8de2-a7e8f4c139ab sending to next pipeline
2026-03-25 22:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 851522a4-7560-5ec5-8de2-a7e8f4c139ab, identifier: 1982489
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/2.jpg not downloaded yet
2026-03-25 22:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-25 22:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478
2026-03-25 22:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db920fb1-a153-5f8c-bed7-0266b14ec159 with identifier: 1982478 to the API
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'db920fb1-a153-5f8c-bed7-0266b14ec159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'ECOSPORT',
 'odometer': 75506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db920fb1-a153-5f8c-bed7-0266b14ec159/db920fb1-a153-5f8c-bed7-0266b14ec159_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ac/3da756e9c15346fd84d166d9c95020e6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD ECOSPORT 1.0I ECOBOOST 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982478%27 HTTP/1.1" 200 None
2026-03-25 22:51:14 [ayvens.be] INFO: Saving data for 1982478: {'created_time': 1774479074.296794, 'last_price_update_time': 1774479074.296804, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982478') HTTP/1.1" 204 0
2026-03-25 22:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-25 22:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489
2026-03-25 22:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 851522a4-7560-5ec5-8de2-a7e8f4c139ab with identifier: 1982489 to the API
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '851522a4-7560-5ec5-8de2-a7e8f4c139ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA',
 'odometer': 43526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851522a4-7560-5ec5-8de2-a7e8f4c139ab/851522a4-7560-5ec5-8de2-a7e8f4c139ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2er/c9f250a5cc2f467287965f2feba21665/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA 1.2 TURBO 96KW S-S GS DRIVING SCHOOL',
 'transmission': 'manual',
 'trim': '1.2 TURBO 96KW S-S GS DRIVING SCHOOL',
 'vin': None,
 'year': 2024}
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982489%27 HTTP/1.1" 200 None
2026-03-25 22:51:14 [ayvens.be] INFO: Saving data for 1982489: {'created_time': 1774479074.661387, 'last_price_update_time': 1774479074.661397, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982489') HTTP/1.1" 204 0
2026-03-25 22:51:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289eb2d0>
2026-03-25 22:51:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Ff6bdb0507def4699a90abdb382ad91fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/8.jpg saved to cache
2026-03-25 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1
2026-03-25 22:51:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0cd54f7-8af7-5842-aa72-e3dae08adbc1, skipping ID generation
2026-03-25 22:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with scrape type 1
2026-03-25 22:51:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0cd54f7-8af7-5842-aa72-e3dae08adbc1 sending to next pipeline
2026-03-25 22:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0cd54f7-8af7-5842-aa72-e3dae08adbc1, identifier: 1982479
2026-03-25 22:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-25 22:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479
2026-03-25 22:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0cd54f7-8af7-5842-aa72-e3dae08adbc1 with identifier: 1982479 to the API
2026-03-25 22:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a0cd54f7-8af7-5842-aa72-e3dae08adbc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 50582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0cd54f7-8af7-5842-aa72-e3dae08adbc1/a0cd54f7-8af7-5842-aa72-e3dae08adbc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/f6bdb0507def4699a90abdb382ad91fe/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982479%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [ayvens.be] INFO: Saving data for 1982479: {'created_time': 1774479075.181869, 'last_price_update_time': 1774479075.181878, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982479') HTTP/1.1" 204 0
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/3.jpg not downloaded yet
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/4.jpg not downloaded yet
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/5.jpg not downloaded yet
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/6.jpg not downloaded yet
2026-03-25 22:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/7.jpg not downloaded yet
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/8.jpg not downloaded yet
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/9.jpg not downloaded yet
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64ab50>
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xq%252F046b27db4bc74c4785e1877ddc0bc5b4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/9.jpg saved to cache
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2da3de6-8252-5e2c-9288-b1863a165294
2026-03-25 22:51:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2da3de6-8252-5e2c-9288-b1863a165294, skipping ID generation
2026-03-25 22:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2da3de6-8252-5e2c-9288-b1863a165294 with scrape type 1
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2da3de6-8252-5e2c-9288-b1863a165294 sending to next pipeline
2026-03-25 22:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2da3de6-8252-5e2c-9288-b1863a165294, identifier: 1982477
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/10.jpg not downloaded yet
2026-03-25 22:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-25 22:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477
2026-03-25 22:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2da3de6-8252-5e2c-9288-b1863a165294 with identifier: 1982477 to the API
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a2da3de6-8252-5e2c-9288-b1863a165294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 83675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 873037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2da3de6-8252-5e2c-9288-b1863a165294/a2da3de6-8252-5e2c-9288-b1863a165294_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xq/046b27db4bc74c4785e1877ddc0bc5b4/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 kWh Long-Range Dual Motor',
 'transmission': 'automatic',
 'trim': '75 kWh Long-Range Dual Motor',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982477%27 HTTP/1.1" 200 None
2026-03-25 22:51:15 [ayvens.be] INFO: Saving data for 1982477: {'created_time': 1774479075.870906, 'last_price_update_time': 1774479075.870917, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982477') HTTP/1.1" 204 0
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9bb10>
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/1.jpg saved to cache
2026-03-25 22:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2364af10>
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/2.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:16 [ayvens.be] INFO: Found listing with ID: 1981135
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-25 22:51:16 [ayvens.be] INFO: Scrape type for 1981135: 2
2026-03-25 22:51:16 [ayvens.be] INFO: Extracting data for car ID: 1981135
2026-03-25 22:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-25 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 2
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79f9428e-091f-5f46-bb9e-7c3db70a593d with scrape type 2
2026-03-25 22:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79f9428e-091f-5f46-bb9e-7c3db70a593d, identifier: 1981135
2026-03-25 22:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-25 22:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135
2026-03-25 22:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79f9428e-091f-5f46-bb9e-7c3db70a593d with identifier: 1981135 to the API
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79f9428e-091f-5f46-bb9e-7c3db70a593d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 39734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 1.2 PURETECH 83 YOU ! MAN S-S',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 83 YOU ! MAN S-S',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981135%27 HTTP/1.1" 200 None
2026-03-25 22:51:16 [ayvens.be] INFO: Saving data for 1981135: {'auction_closing_time': 1774855800.0, 'created_time': 1774392326.917128, 'last_price_update_time': 1774479076.478758}
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981135') HTTP/1.1" 204 0
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288bf650>
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/9.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2d110>
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/3.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2a64c6d0>
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/4.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23fe8a50>
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/4.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28808ad0>
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252Fcf2586e35b61463085d2ef8c64ceab71%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/8.jpg saved to cache
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b
2026-03-25 22:51:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b, skipping ID generation
2026-03-25 22:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with scrape type 1
2026-03-25 22:51:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b sending to next pipeline
2026-03-25 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b, identifier: 1982476
2026-03-25 22:51:17 [ayvens.be] INFO: Found listing with ID: 1981136
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-25 22:51:17 [ayvens.be] INFO: Scrape type for 1981136: 2
2026-03-25 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1981136
2026-03-25 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-25 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 2
2026-03-25 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ec57dc-bca1-51b9-9171-f999955cb521 with scrape type 2
2026-03-25 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 46ec57dc-bca1-51b9-9171-f999955cb521, identifier: 1981136
2026-03-25 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-25 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476
2026-03-25 22:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b with identifier: 1982476 to the API
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b/f69bc805-9b22-5ecf-9ec8-b1dfc34c9e0b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/cf2586e35b61463085d2ef8c64ceab71/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982476%27 HTTP/1.1" 200 None
2026-03-25 22:51:17 [ayvens.be] INFO: Saving data for 1982476: {'created_time': 1774479077.467721, 'last_price_update_time': 1774479077.467731, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982476') HTTP/1.1" 204 0
2026-03-25 22:51:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-25 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136
2026-03-25 22:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 46ec57dc-bca1-51b9-9171-f999955cb521 with identifier: 1981136 to the API
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '46ec57dc-bca1-51b9-9171-f999955cb521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 138625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981136%27 HTTP/1.1" 200 None
2026-03-25 22:51:17 [ayvens.be] INFO: Saving data for 1981136: {'auction_closing_time': 1774855800.0, 'created_time': 1774392341.835887, 'last_price_update_time': 1774479077.784994}
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981136') HTTP/1.1" 204 0
2026-03-25 22:51:17 [ayvens.be] INFO: Found listing with ID: 1981137
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-25 22:51:17 [ayvens.be] INFO: Scrape type for 1981137: 2
2026-03-25 22:51:17 [ayvens.be] INFO: Extracting data for car ID: 1981137
2026-03-25 22:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-25 22:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 2
2026-03-25 22:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a691153-75fd-5fd6-8d9c-90017e3894b2 with scrape type 2
2026-03-25 22:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a691153-75fd-5fd6-8d9c-90017e3894b2, identifier: 1981137
2026-03-25 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-25 22:51:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137
2026-03-25 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a691153-75fd-5fd6-8d9c-90017e3894b2 with identifier: 1981137 to the API
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2a691153-75fd-5fd6-8d9c-90017e3894b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 113121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981137%27 HTTP/1.1" 200 None
2026-03-25 22:51:18 [ayvens.be] INFO: Saving data for 1981137: {'auction_closing_time': 1774855800.0, 'created_time': 1774392329.486292, 'last_price_update_time': 1774479078.231664}
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981137') HTTP/1.1" 204 0
2026-03-25 22:51:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:18 [ayvens.be] INFO: Found listing with ID: 1981138
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-25 22:51:18 [ayvens.be] INFO: Scrape type for 1981138: 2
2026-03-25 22:51:18 [ayvens.be] INFO: Extracting data for car ID: 1981138
2026-03-25 22:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-25 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 2
2026-03-25 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dff7df-9b11-5d60-91fa-a74a269584dd with scrape type 2
2026-03-25 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55dff7df-9b11-5d60-91fa-a74a269584dd, identifier: 1981138
2026-03-25 22:51:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2892ff10>
2026-03-25 22:51:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F2d7467bd00cd4bc88ccb77c2123673d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/1.jpg saved to cache
2026-03-25 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef
2026-03-25 22:51:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef, skipping ID generation
2026-03-25 22:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with scrape type 1
2026-03-25 22:51:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef sending to next pipeline
2026-03-25 22:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef, identifier: 1982474
2026-03-25 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-25 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138
2026-03-25 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55dff7df-9b11-5d60-91fa-a74a269584dd with identifier: 1981138 to the API
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '55dff7df-9b11-5d60-91fa-a74a269584dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 133256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TDI 35 120KW S TRON. B. ED. SP',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 120KW S TRON. B. ED. SP',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981138%27 HTTP/1.1" 200 None
2026-03-25 22:51:18 [ayvens.be] INFO: Saving data for 1981138: {'auction_closing_time': 1774855800.0, 'created_time': 1774392335.772605, 'last_price_update_time': 1774479078.808365}
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981138') HTTP/1.1" 204 0
2026-03-25 22:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-25 22:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474
2026-03-25 22:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef with identifier: 1982474 to the API
2026-03-25 22:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 74440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 985770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 950327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef/aa6a5cdb-54ac-5c28-bf6e-156c60d4f1ef_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1008158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/2d7467bd00cd4bc88ccb77c2123673d6/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982474%27 HTTP/1.1" 200 None
2026-03-25 22:51:19 [ayvens.be] INFO: Saving data for 1982474: {'created_time': 1774479079.160865, 'last_price_update_time': 1774479079.160874, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982474') HTTP/1.1" 204 0
2026-03-25 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:19 [ayvens.be] INFO: Found listing with ID: 1981139
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-25 22:51:19 [ayvens.be] INFO: Scrape type for 1981139: 2
2026-03-25 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1981139
2026-03-25 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-25 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 2
2026-03-25 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e40e898-1a73-5900-a6ac-3adfd092d841 with scrape type 2
2026-03-25 22:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3e40e898-1a73-5900-a6ac-3adfd092d841, identifier: 1981139
2026-03-25 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-25 22:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139
2026-03-25 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3e40e898-1a73-5900-a6ac-3adfd092d841 with identifier: 1981139 to the API
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '3e40e898-1a73-5900-a6ac-3adfd092d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 44757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981139%27 HTTP/1.1" 200 None
2026-03-25 22:51:19 [ayvens.be] INFO: Saving data for 1981139: {'auction_closing_time': 1774855800.0, 'created_time': 1774392332.388943, 'last_price_update_time': 1774479079.57684}
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981139') HTTP/1.1" 204 0
2026-03-25 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:19 [ayvens.be] INFO: Found listing with ID: 1981140
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-25 22:51:19 [ayvens.be] INFO: Scrape type for 1981140: 2
2026-03-25 22:51:19 [ayvens.be] INFO: Extracting data for car ID: 1981140
2026-03-25 22:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-25 22:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 2
2026-03-25 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7ceea0-d793-598a-b897-0075675d2746 with scrape type 2
2026-03-25 22:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e7ceea0-d793-598a-b897-0075675d2746, identifier: 1981140
2026-03-25 22:51:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2152b890>
2026-03-25 22:51:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/5.jpg saved to cache
2026-03-25 22:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-25 22:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140
2026-03-25 22:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e7ceea0-d793-598a-b897-0075675d2746 with identifier: 1981140 to the API
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '6e7ceea0-d793-598a-b897-0075675d2746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 123901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 E AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 E AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981140%27 HTTP/1.1" 200 None
2026-03-25 22:51:20 [ayvens.be] INFO: Saving data for 1981140: {'auction_closing_time': 1774855800.0, 'created_time': 1774392334.949015, 'last_price_update_time': 1774479080.068586}
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981140') HTTP/1.1" 204 0
2026-03-25 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:20 [ayvens.be] INFO: Found listing with ID: 1981141
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-25 22:51:20 [ayvens.be] INFO: Scrape type for 1981141: 2
2026-03-25 22:51:20 [ayvens.be] INFO: Extracting data for car ID: 1981141
2026-03-25 22:51:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-25 22:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 2
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e756c7e5-3ba1-5508-b45b-031fde5bc5dd with scrape type 2
2026-03-25 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e756c7e5-3ba1-5508-b45b-031fde5bc5dd, identifier: 1981141
2026-03-25 22:51:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-25 22:51:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141
2026-03-25 22:51:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e756c7e5-3ba1-5508-b45b-031fde5bc5dd with identifier: 1981141 to the API
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e756c7e5-3ba1-5508-b45b-031fde5bc5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 40457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'transmission': 'manual',
 'trim': '2.3 DCI 150 EN. BLUE GR CONFORT L2H2 35',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981141%27 HTTP/1.1" 200 None
2026-03-25 22:51:20 [ayvens.be] INFO: Saving data for 1981141: {'auction_closing_time': 1774855800.0, 'created_time': 1774392337.685238, 'last_price_update_time': 1774479080.566667}
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981141') HTTP/1.1" 204 0
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215200d0>
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/7.jpg saved to cache
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28934f50>
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F56d3dd420def4f6d8f7093c3af1a31f0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/6.jpg saved to cache
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b76150a-95b6-5800-8694-d5562a33e0d7
2026-03-25 22:51:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b76150a-95b6-5800-8694-d5562a33e0d7, skipping ID generation
2026-03-25 22:51:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b76150a-95b6-5800-8694-d5562a33e0d7 with scrape type 1
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b76150a-95b6-5800-8694-d5562a33e0d7 sending to next pipeline
2026-03-25 22:51:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b76150a-95b6-5800-8694-d5562a33e0d7, identifier: 1982170
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28935610>
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/2.jpg saved to cache
2026-03-25 22:51:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236ae090>
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/6.jpg saved to cache
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:21 [ayvens.be] INFO: Found listing with ID: 1981142
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-25 22:51:21 [ayvens.be] INFO: Scrape type for 1981142: 2
2026-03-25 22:51:21 [ayvens.be] INFO: Extracting data for car ID: 1981142
2026-03-25 22:51:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-25 22:51:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 2
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with scrape type 2
2026-03-25 22:51:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932ba259-a9f5-5bad-9ff0-16f2a67d1110, identifier: 1981142
2026-03-25 22:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b76150a-95b6-5800-8694-d5562a33e0d7 with identifier: 1982170
2026-03-25 22:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b76150a-95b6-5800-8694-d5562a33e0d7 with identifier: 1982170
2026-03-25 22:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b76150a-95b6-5800-8694-d5562a33e0d7 with identifier: 1982170 to the API
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '2b76150a-95b6-5800-8694-d5562a33e0d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 47883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 889772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b76150a-95b6-5800-8694-d5562a33e0d7/2b76150a-95b6-5800-8694-d5562a33e0d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/56d3dd420def4f6d8f7093c3af1a31f0/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982170%27 HTTP/1.1" 200 None
2026-03-25 22:51:21 [ayvens.be] INFO: Saving data for 1982170: {'created_time': 1774479081.489874, 'last_price_update_time': 1774479081.489883, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982170') HTTP/1.1" 204 0
2026-03-25 22:51:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-25 22:51:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142
2026-03-25 22:51:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932ba259-a9f5-5bad-9ff0-16f2a67d1110 with identifier: 1981142 to the API
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '932ba259-a9f5-5bad-9ff0-16f2a67d1110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 61616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 GT',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 GT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981142%27 HTTP/1.1" 200 None
2026-03-25 22:51:21 [ayvens.be] INFO: Saving data for 1981142: {'auction_closing_time': 1774855800.0, 'created_time': 1774392340.125317, 'last_price_update_time': 1774479081.78389}
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981142') HTTP/1.1" 204 0
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f110>
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/9.jpg saved to cache
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28396550>
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/8.jpg saved to cache
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b9a750>
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/3.jpg saved to cache
2026-03-25 22:51:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:21 [ayvens.be] INFO: Found listing with ID: 1981143
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-25 22:51:22 [ayvens.be] INFO: Scrape type for 1981143: 2
2026-03-25 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1981143
2026-03-25 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-25 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 2
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7f49ce1-9cb3-5e49-8374-cacc8536af7c with scrape type 2
2026-03-25 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7f49ce1-9cb3-5e49-8374-cacc8536af7c, identifier: 1981143
2026-03-25 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-25 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143
2026-03-25 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7f49ce1-9cb3-5e49-8374-cacc8536af7c with identifier: 1981143 to the API
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e7f49ce1-9cb3-5e49-8374-cacc8536af7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 116865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981143%27 HTTP/1.1" 200 None
2026-03-25 22:51:22 [ayvens.be] INFO: Saving data for 1981143: {'auction_closing_time': 1774855800.0, 'created_time': 1774392341.057917, 'last_price_update_time': 1774479082.370544}
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981143') HTTP/1.1" 204 0
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df8250>
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/9.jpg saved to cache
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28ae5450>
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/1.jpg saved to cache
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:22 [ayvens.be] INFO: Found listing with ID: 1981144
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-25 22:51:22 [ayvens.be] INFO: Scrape type for 1981144: 2
2026-03-25 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1981144
2026-03-25 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-25 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 2
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with scrape type 2
2026-03-25 22:51:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65, identifier: 1981144
2026-03-25 22:51:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-25 22:51:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144
2026-03-25 22:51:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e99ef99f-7fc5-5a59-9b9d-3745dc92bd65 with identifier: 1981144 to the API
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'e99ef99f-7fc5-5a59-9b9d-3745dc92bd65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 126429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981144%27 HTTP/1.1" 200 None
2026-03-25 22:51:22 [ayvens.be] INFO: Saving data for 1981144: {'auction_closing_time': 1774855800.0, 'created_time': 1774392342.981161, 'last_price_update_time': 1774479082.908442}
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981144') HTTP/1.1" 204 0
2026-03-25 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:22 [ayvens.be] INFO: Found listing with ID: 1981145
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-25 22:51:22 [ayvens.be] INFO: Scrape type for 1981145: 2
2026-03-25 22:51:22 [ayvens.be] INFO: Extracting data for car ID: 1981145
2026-03-25 22:51:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-25 22:51:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 2
2026-03-25 22:51:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with scrape type 2
2026-03-25 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75831d27-db1a-57be-b9a4-6b8922f3a7f8, identifier: 1981145
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b36b85a10>
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/4.jpg saved to cache
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-25 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145
2026-03-25 22:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75831d27-db1a-57be-b9a4-6b8922f3a7f8 with identifier: 1981145 to the API
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '75831d27-db1a-57be-b9a4-6b8922f3a7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 75263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 AMBITION',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 AMBITION',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981145%27 HTTP/1.1" 200 None
2026-03-25 22:51:23 [ayvens.be] INFO: Saving data for 1981145: {'auction_closing_time': 1774855800.0, 'created_time': 1774392344.203996, 'last_price_update_time': 1774479083.351261}
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981145') HTTP/1.1" 204 0
2026-03-25 22:51:23 [ayvens.be] INFO: Found listing with ID: 1981146
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-25 22:51:23 [ayvens.be] INFO: Scrape type for 1981146: 2
2026-03-25 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1981146
2026-03-25 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-25 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 2
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with scrape type 2
2026-03-25 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c80c1a2f-015a-5969-ab5d-64b9e6a66da7, identifier: 1981146
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288be1d0>
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/5.jpg saved to cache
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-25 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146
2026-03-25 22:51:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c80c1a2f-015a-5969-ab5d-64b9e6a66da7 with identifier: 1981146 to the API
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c80c1a2f-015a-5969-ab5d-64b9e6a66da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 126846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981146%27 HTTP/1.1" 200 None
2026-03-25 22:51:23 [ayvens.be] INFO: Saving data for 1981146: {'auction_closing_time': 1774855800.0, 'created_time': 1774392346.312486, 'last_price_update_time': 1774479083.792679}
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981146') HTTP/1.1" 204 0
2026-03-25 22:51:23 [ayvens.be] INFO: Found listing with ID: 1981147
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-25 22:51:23 [ayvens.be] INFO: Scrape type for 1981147: 2
2026-03-25 22:51:23 [ayvens.be] INFO: Extracting data for car ID: 1981147
2026-03-25 22:51:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-25 22:51:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 2
2026-03-25 22:51:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d383ddfc-c6f8-58f9-8819-387d76fdbede with scrape type 2
2026-03-25 22:51:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d383ddfc-c6f8-58f9-8819-387d76fdbede, identifier: 1981147
2026-03-25 22:51:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-25 22:51:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147
2026-03-25 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d383ddfc-c6f8-58f9-8819-387d76fdbede with identifier: 1981147 to the API
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd383ddfc-c6f8-58f9-8819-387d76fdbede',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 87676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.2 PURETECH 96KW S-S GT PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981147%27 HTTP/1.1" 200 None
2026-03-25 22:51:24 [ayvens.be] INFO: Saving data for 1981147: {'auction_closing_time': 1774855800.0, 'created_time': 1774392348.212917, 'last_price_update_time': 1774479084.181766}
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981147') HTTP/1.1" 204 0
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2368e690>
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/6.jpg saved to cache
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2901f7d0>
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/9.jpg saved to cache
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289ea6d0>
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/10.jpg saved to cache
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:24 [ayvens.be] INFO: Found listing with ID: 1981148
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-25 22:51:24 [ayvens.be] INFO: Scrape type for 1981148: 2
2026-03-25 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1981148
2026-03-25 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-25 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 2
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with scrape type 2
2026-03-25 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95c75bc2-fcb0-517e-8e3c-23cf7736db37, identifier: 1981148
2026-03-25 22:51:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-25 22:51:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148
2026-03-25 22:51:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95c75bc2-fcb0-517e-8e3c-23cf7736db37 with identifier: 1981148 to the API
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '95c75bc2-fcb0-517e-8e3c-23cf7736db37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 190552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV R-Design DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV R-Design DCT STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981148%27 HTTP/1.1" 200 None
2026-03-25 22:51:24 [ayvens.be] INFO: Saving data for 1981148: {'auction_closing_time': 1774855800.0, 'created_time': 1774392349.406868, 'last_price_update_time': 1774479084.773788}
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981148') HTTP/1.1" 204 0
2026-03-25 22:51:24 [ayvens.be] INFO: Found listing with ID: 1981149
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-25 22:51:24 [ayvens.be] INFO: Scrape type for 1981149: 2
2026-03-25 22:51:24 [ayvens.be] INFO: Extracting data for car ID: 1981149
2026-03-25 22:51:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-25 22:51:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 2
2026-03-25 22:51:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95495680-c237-5901-b6dc-368b4f2bde71 with scrape type 2
2026-03-25 22:51:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 95495680-c237-5901-b6dc-368b4f2bde71, identifier: 1981149
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28831210>
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/8.jpg saved to cache
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2890c450>
2026-03-25 22:51:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cx%252Fda187d83a02f4afd9cd4ea55b270778a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/7.jpg saved to cache
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e07c39a8-9736-55b4-97cd-35de75f7655a
2026-03-25 22:51:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e07c39a8-9736-55b4-97cd-35de75f7655a, skipping ID generation
2026-03-25 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e07c39a8-9736-55b4-97cd-35de75f7655a with scrape type 1
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e07c39a8-9736-55b4-97cd-35de75f7655a sending to next pipeline
2026-03-25 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e07c39a8-9736-55b4-97cd-35de75f7655a, identifier: 1982491
2026-03-25 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-25 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149
2026-03-25 22:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 95495680-c237-5901-b6dc-368b4f2bde71 with identifier: 1981149 to the API
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '95495680-c237-5901-b6dc-368b4f2bde71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 164034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981149%27 HTTP/1.1" 200 None
2026-03-25 22:51:25 [ayvens.be] INFO: Saving data for 1981149: {'auction_closing_time': 1774855800.0, 'created_time': 1774392351.239466, 'last_price_update_time': 1774479085.429022}
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981149') HTTP/1.1" 204 0
2026-03-25 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-25 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491
2026-03-25 22:51:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e07c39a8-9736-55b4-97cd-35de75f7655a with identifier: 1982491 to the API
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e07c39a8-9736-55b4-97cd-35de75f7655a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 72458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e07c39a8-9736-55b4-97cd-35de75f7655a/e07c39a8-9736-55b4-97cd-35de75f7655a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cx/da187d83a02f4afd9cd4ea55b270778a/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982491%27 HTTP/1.1" 200 None
2026-03-25 22:51:25 [ayvens.be] INFO: Saving data for 1982491: {'created_time': 1774479085.777469, 'last_price_update_time': 1774479085.777479, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982491') HTTP/1.1" 204 0
2026-03-25 22:51:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:25 [ayvens.be] INFO: Found listing with ID: 1981150
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-25 22:51:25 [ayvens.be] INFO: Scrape type for 1981150: 2
2026-03-25 22:51:25 [ayvens.be] INFO: Extracting data for car ID: 1981150
2026-03-25 22:51:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-25 22:51:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 2
2026-03-25 22:51:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d18c03-5a70-52d6-8f3a-d501780a05bb with scrape type 2
2026-03-25 22:51:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67d18c03-5a70-52d6-8f3a-d501780a05bb, identifier: 1981150
2026-03-25 22:51:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-25 22:51:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150
2026-03-25 22:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67d18c03-5a70-52d6-8f3a-d501780a05bb with identifier: 1981150 to the API
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67d18c03-5a70-52d6-8f3a-d501780a05bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 33608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981150%27 HTTP/1.1" 200 None
2026-03-25 22:51:26 [ayvens.be] INFO: Saving data for 1981150: {'auction_closing_time': 1774855800.0, 'created_time': 1774392352.904018, 'last_price_update_time': 1774479086.162584}
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981150') HTTP/1.1" 204 0
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28741a10>
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/8.jpg saved to cache
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b283b6150>
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F77e510e7e50843ae8a78839cdb533035%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/10.jpg saved to cache
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcf27002-f671-51e6-901d-6803e65eed45
2026-03-25 22:51:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcf27002-f671-51e6-901d-6803e65eed45, skipping ID generation
2026-03-25 22:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf27002-f671-51e6-901d-6803e65eed45 with scrape type 1
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcf27002-f671-51e6-901d-6803e65eed45 sending to next pipeline
2026-03-25 22:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bcf27002-f671-51e6-901d-6803e65eed45, identifier: 1982490
2026-03-25 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:26 [ayvens.be] INFO: Found listing with ID: 1981151
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-25 22:51:26 [ayvens.be] INFO: Scrape type for 1981151: 2
2026-03-25 22:51:26 [ayvens.be] INFO: Extracting data for car ID: 1981151
2026-03-25 22:51:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-25 22:51:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 2
2026-03-25 22:51:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c73026-a151-5067-8118-8a4478549aa2 with scrape type 2
2026-03-25 22:51:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c73026-a151-5067-8118-8a4478549aa2, identifier: 1981151
2026-03-25 22:51:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-25 22:51:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490
2026-03-25 22:51:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bcf27002-f671-51e6-901d-6803e65eed45 with identifier: 1982490 to the API
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bcf27002-f671-51e6-901d-6803e65eed45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41012',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 44028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 922500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcf27002-f671-51e6-901d-6803e65eed45/bcf27002-f671-51e6-901d-6803e65eed45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 891060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/77e510e7e50843ae8a78839cdb533035/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2 TURBO 74KW S-S ELEGANCE',
 'transmission': 'manual',
 'trim': '1.2 TURBO 74KW S-S ELEGANCE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982490%27 HTTP/1.1" 200 None
2026-03-25 22:51:26 [ayvens.be] INFO: Saving data for 1982490: {'created_time': 1774479086.913853, 'last_price_update_time': 1774479086.913862, 'auction_closing_time': 1774942200.0}
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982490') HTTP/1.1" 204 0
2026-03-25 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-25 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151
2026-03-25 22:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c73026-a151-5067-8118-8a4478549aa2 with identifier: 1981151 to the API
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'SKYSCRAPER GRAU',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b2c73026-a151-5067-8118-8a4478549aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 57590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 215KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 215KW AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981151%27 HTTP/1.1" 200 None
2026-03-25 22:51:27 [ayvens.be] INFO: Saving data for 1981151: {'auction_closing_time': 1774855800.0, 'created_time': 1774392354.444965, 'last_price_update_time': 1774479087.306934}
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981151') HTTP/1.1" 204 0
2026-03-25 22:51:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28831f50>
2026-03-25 22:51:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fee7fd1cdd9f44279bf4518c2490db53c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/7.jpg saved to cache
2026-03-25 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a47c5484-1100-55a0-bd8d-21e13244e7f2
2026-03-25 22:51:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a47c5484-1100-55a0-bd8d-21e13244e7f2, skipping ID generation
2026-03-25 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47c5484-1100-55a0-bd8d-21e13244e7f2 with scrape type 1
2026-03-25 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a47c5484-1100-55a0-bd8d-21e13244e7f2 sending to next pipeline
2026-03-25 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a47c5484-1100-55a0-bd8d-21e13244e7f2, identifier: 1982169
2026-03-25 22:51:27 [ayvens.be] INFO: Found listing with ID: 1981152
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-25 22:51:27 [ayvens.be] INFO: Scrape type for 1981152: 2
2026-03-25 22:51:27 [ayvens.be] INFO: Extracting data for car ID: 1981152
2026-03-25 22:51:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-25 22:51:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 2
2026-03-25 22:51:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd809381-d151-5296-b62b-a4d865d26fdf with scrape type 2
2026-03-25 22:51:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cd809381-d151-5296-b62b-a4d865d26fdf, identifier: 1981152
2026-03-25 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a47c5484-1100-55a0-bd8d-21e13244e7f2 with identifier: 1982169
2026-03-25 22:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a47c5484-1100-55a0-bd8d-21e13244e7f2 with identifier: 1982169
2026-03-25 22:51:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a47c5484-1100-55a0-bd8d-21e13244e7f2 with identifier: 1982169 to the API
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a47c5484-1100-55a0-bd8d-21e13244e7f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 36277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 821478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47c5484-1100-55a0-bd8d-21e13244e7f2/a47c5484-1100-55a0-bd8d-21e13244e7f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/ee7fd1cdd9f44279bf4518c2490db53c/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982169%27 HTTP/1.1" 200 None
2026-03-25 22:51:27 [ayvens.be] INFO: Saving data for 1982169: {'created_time': 1774479087.893497, 'last_price_update_time': 1774479087.893507, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982169') HTTP/1.1" 204 0
2026-03-25 22:51:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-25 22:51:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152
2026-03-25 22:51:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cd809381-d151-5296-b62b-a4d865d26fdf with identifier: 1981152 to the API
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cd809381-d151-5296-b62b-a4d865d26fdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW ACENTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW ACENTA XTRONIC',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981152%27 HTTP/1.1" 200 None
2026-03-25 22:51:28 [ayvens.be] INFO: Saving data for 1981152: {'auction_closing_time': 1774855800.0, 'created_time': 1774392356.262048, 'last_price_update_time': 1774479088.197241}
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981152') HTTP/1.1" 204 0
2026-03-25 22:51:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:28 [ayvens.be] INFO: Found listing with ID: 1981153
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-25 22:51:28 [ayvens.be] INFO: Scrape type for 1981153: 2
2026-03-25 22:51:28 [ayvens.be] INFO: Extracting data for car ID: 1981153
2026-03-25 22:51:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-25 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 2
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2eb5f30-0659-59ec-97ca-b4d7614e8aba with scrape type 2
2026-03-25 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2eb5f30-0659-59ec-97ca-b4d7614e8aba, identifier: 1981153
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b5e450>
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ap%252Fabdbc9bda8864436bc1bb68ba7dfc838%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/5.jpg saved to cache
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf8d0e46-9bf4-5289-9929-15c67aea8157
2026-03-25 22:51:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf8d0e46-9bf4-5289-9929-15c67aea8157, skipping ID generation
2026-03-25 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf8d0e46-9bf4-5289-9929-15c67aea8157 with scrape type 1
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf8d0e46-9bf4-5289-9929-15c67aea8157 sending to next pipeline
2026-03-25 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cf8d0e46-9bf4-5289-9929-15c67aea8157, identifier: 1982168
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815b90>
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/10.jpg saved to cache
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b215101d0>
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ah%252F85881eac94134e34b29b480bdf492e53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/1.jpg saved to cache
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3546b3e-e1ce-5693-bd03-a57a08da25a4
2026-03-25 22:51:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3546b3e-e1ce-5693-bd03-a57a08da25a4, skipping ID generation
2026-03-25 22:51:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3546b3e-e1ce-5693-bd03-a57a08da25a4 with scrape type 1
2026-03-25 22:51:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3546b3e-e1ce-5693-bd03-a57a08da25a4 sending to next pipeline
2026-03-25 22:51:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3546b3e-e1ce-5693-bd03-a57a08da25a4, identifier: 1982167
2026-03-25 22:51:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-25 22:51:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153
2026-03-25 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2eb5f30-0659-59ec-97ca-b4d7614e8aba with identifier: 1981153 to the API
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a2eb5f30-0659-59ec-97ca-b4d7614e8aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 48318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981153%27 HTTP/1.1" 200 None
2026-03-25 22:51:29 [ayvens.be] INFO: Saving data for 1981153: {'auction_closing_time': 1774855800.0, 'created_time': 1774392357.339076, 'last_price_update_time': 1774479089.234969}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981153') HTTP/1.1" 204 0
2026-03-25 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cf8d0e46-9bf4-5289-9929-15c67aea8157 with identifier: 1982168
2026-03-25 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cf8d0e46-9bf4-5289-9929-15c67aea8157 with identifier: 1982168
2026-03-25 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cf8d0e46-9bf4-5289-9929-15c67aea8157 with identifier: 1982168 to the API
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf8d0e46-9bf4-5289-9929-15c67aea8157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 59038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 824108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 758055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf8d0e46-9bf4-5289-9929-15c67aea8157/cf8d0e46-9bf4-5289-9929-15c67aea8157_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ap/abdbc9bda8864436bc1bb68ba7dfc838/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982168%27 HTTP/1.1" 200 None
2026-03-25 22:51:29 [ayvens.be] INFO: Saving data for 1982168: {'created_time': 1774479089.571274, 'last_price_update_time': 1774479089.571285, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982168') HTTP/1.1" 204 0
2026-03-25 22:51:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3546b3e-e1ce-5693-bd03-a57a08da25a4 with identifier: 1982167
2026-03-25 22:51:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3546b3e-e1ce-5693-bd03-a57a08da25a4 with identifier: 1982167
2026-03-25 22:51:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3546b3e-e1ce-5693-bd03-a57a08da25a4 with identifier: 1982167 to the API
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3546b3e-e1ce-5693-bd03-a57a08da25a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 38891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3546b3e-e1ce-5693-bd03-a57a08da25a4/a3546b3e-e1ce-5693-bd03-a57a08da25a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ah/85881eac94134e34b29b480bdf492e53/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982167%27 HTTP/1.1" 200 None
2026-03-25 22:51:29 [ayvens.be] INFO: Saving data for 1982167: {'created_time': 1774479089.882539, 'last_price_update_time': 1774479089.882549, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982167') HTTP/1.1" 204 0
2026-03-25 22:51:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:29 [ayvens.be] INFO: Found listing with ID: 1981154
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-25 22:51:29 [ayvens.be] INFO: Scrape type for 1981154: 2
2026-03-25 22:51:29 [ayvens.be] INFO: Extracting data for car ID: 1981154
2026-03-25 22:51:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-25 22:51:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 2
2026-03-25 22:51:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with scrape type 2
2026-03-25 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d, identifier: 1981154
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b289074d0>
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/8.jpg saved to cache
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-25 22:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154
2026-03-25 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fa89c7-74f2-5738-9f5a-2c2b02344a0d with identifier: 1981154 to the API
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '30fa89c7-74f2-5738-9f5a-2c2b02344a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 101522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 PureTech PHEV Shine S&S',
 'transmission': 'automatic',
 'trim': '1.6 PureTech PHEV Shine S&S',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981154%27 HTTP/1.1" 200 None
2026-03-25 22:51:30 [ayvens.be] INFO: Saving data for 1981154: {'auction_closing_time': 1774855800.0, 'created_time': 1774392358.96782, 'last_price_update_time': 1774479090.352109}
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981154') HTTP/1.1" 204 0
2026-03-25 22:51:30 [ayvens.be] INFO: Found listing with ID: 1981155
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-25 22:51:30 [ayvens.be] INFO: Scrape type for 1981155: 2
2026-03-25 22:51:30 [ayvens.be] INFO: Extracting data for car ID: 1981155
2026-03-25 22:51:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-25 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 2
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d9d405-e816-59b5-8743-cae75190dd16 with scrape type 2
2026-03-25 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 40d9d405-e816-59b5-8743-cae75190dd16, identifier: 1981155
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28906910>
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F89084eb33b434317834616b16aafc756%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/9.jpg saved to cache
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-03-25 22:51:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2, skipping ID generation
2026-03-25 22:51:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with scrape type 1
2026-03-25 22:51:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 sending to next pipeline
2026-03-25 22:51:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2, identifier: 1982166
2026-03-25 22:51:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-25 22:51:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155
2026-03-25 22:51:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 40d9d405-e816-59b5-8743-cae75190dd16 with identifier: 1981155 to the API
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '40d9d405-e816-59b5-8743-cae75190dd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 93963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981155%27 HTTP/1.1" 200 None
2026-03-25 22:51:31 [ayvens.be] INFO: Saving data for 1981155: {'auction_closing_time': 1774855800.0, 'created_time': 1774392361.295842, 'last_price_update_time': 1774479091.005355}
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981155') HTTP/1.1" 204 0
2026-03-25 22:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1982166
2026-03-25 22:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1982166
2026-03-25 22:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1982166 to the API
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 86101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/89084eb33b434317834616b16aafc756/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982166%27 HTTP/1.1" 200 None
2026-03-25 22:51:31 [ayvens.be] INFO: Saving data for 1982166: {'created_time': 1774479091.561437, 'last_price_update_time': 1774479091.561447, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982166') HTTP/1.1" 204 0
2026-03-25 22:51:31 [ayvens.be] INFO: Found listing with ID: 1981156
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-25 22:51:31 [ayvens.be] INFO: Scrape type for 1981156: 2
2026-03-25 22:51:31 [ayvens.be] INFO: Extracting data for car ID: 1981156
2026-03-25 22:51:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-25 22:51:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 2
2026-03-25 22:51:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a9001d-4382-56d9-8dea-163a7a9c475a with scrape type 2
2026-03-25 22:51:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79a9001d-4382-56d9-8dea-163a7a9c475a, identifier: 1981156
2026-03-25 22:51:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-25 22:51:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156
2026-03-25 22:51:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 79a9001d-4382-56d9-8dea-163a7a9c475a with identifier: 1981156 to the API
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '79a9001d-4382-56d9-8dea-163a7a9c475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 86513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981156%27 HTTP/1.1" 200 None
2026-03-25 22:51:32 [ayvens.be] INFO: Saving data for 1981156: {'auction_closing_time': 1774855800.0, 'created_time': 1774392363.220389, 'last_price_update_time': 1774479092.034766}
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981156') HTTP/1.1" 204 0
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23646150>
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/8.jpg saved to cache
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:51:32 [ayvens.be] INFO: Found listing with ID: 1981157
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-25 22:51:32 [ayvens.be] INFO: Scrape type for 1981157: 2
2026-03-25 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1981157
2026-03-25 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-25 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 2
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7de6e15d-a6a6-5347-8ee9-97962eae7102 with scrape type 2
2026-03-25 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7de6e15d-a6a6-5347-8ee9-97962eae7102, identifier: 1981157
2026-03-25 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-25 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157
2026-03-25 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7de6e15d-a6a6-5347-8ee9-97962eae7102 with identifier: 1981157 to the API
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7de6e15d-a6a6-5347-8ee9-97962eae7102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 92277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981157%27 HTTP/1.1" 200 None
2026-03-25 22:51:32 [ayvens.be] INFO: Saving data for 1981157: {'auction_closing_time': 1774855800.0, 'created_time': 1774392365.077413, 'last_price_update_time': 1774479092.48684}
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981157') HTTP/1.1" 204 0
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766350>
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/9.jpg saved to cache
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:32 [ayvens.be] INFO: Found listing with ID: 1981158
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-25 22:51:32 [ayvens.be] INFO: Scrape type for 1981158: 2
2026-03-25 22:51:32 [ayvens.be] INFO: Extracting data for car ID: 1981158
2026-03-25 22:51:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-25 22:51:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 2
2026-03-25 22:51:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with scrape type 2
2026-03-25 22:51:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3, identifier: 1981158
2026-03-25 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-25 22:51:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158
2026-03-25 22:51:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3 with identifier: 1981158 to the API
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56cdfc2-f6a0-5415-8a30-9cc226ccf3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 171872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981158%27 HTTP/1.1" 200 None
2026-03-25 22:51:33 [ayvens.be] INFO: Saving data for 1981158: {'auction_closing_time': 1774855800.0, 'created_time': 1774392366.228704, 'last_price_update_time': 1774479093.005127}
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981158') HTTP/1.1" 204 0
2026-03-25 22:51:33 [ayvens.be] INFO: Found listing with ID: 1981159
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-25 22:51:33 [ayvens.be] INFO: Scrape type for 1981159: 2
2026-03-25 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1981159
2026-03-25 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-25 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 2
2026-03-25 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc8ad3b-0a22-5704-af7f-eb08498cc608 with scrape type 2
2026-03-25 22:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfc8ad3b-0a22-5704-af7f-eb08498cc608, identifier: 1981159
2026-03-25 22:51:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28766010>
2026-03-25 22:51:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F604fcc1f3f154955bdc851615f26743e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/7.jpg saved to cache
2026-03-25 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7ea013f-70b4-5b19-89cd-347303b90006
2026-03-25 22:51:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7ea013f-70b4-5b19-89cd-347303b90006, skipping ID generation
2026-03-25 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ea013f-70b4-5b19-89cd-347303b90006 with scrape type 1
2026-03-25 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7ea013f-70b4-5b19-89cd-347303b90006 sending to next pipeline
2026-03-25 22:51:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7ea013f-70b4-5b19-89cd-347303b90006, identifier: 1982165
2026-03-25 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-25 22:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159
2026-03-25 22:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bfc8ad3b-0a22-5704-af7f-eb08498cc608 with identifier: 1981159 to the API
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bfc8ad3b-0a22-5704-af7f-eb08498cc608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 50569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981159%27 HTTP/1.1" 200 None
2026-03-25 22:51:33 [ayvens.be] INFO: Saving data for 1981159: {'auction_closing_time': 1774855800.0, 'created_time': 1774392369.032312, 'last_price_update_time': 1774479093.561063}
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981159') HTTP/1.1" 204 0
2026-03-25 22:51:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1982165
2026-03-25 22:51:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1982165
2026-03-25 22:51:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7ea013f-70b4-5b19-89cd-347303b90006 with identifier: 1982165 to the API
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7ea013f-70b4-5b19-89cd-347303b90006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 30002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7ea013f-70b4-5b19-89cd-347303b90006/b7ea013f-70b4-5b19-89cd-347303b90006_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/604fcc1f3f154955bdc851615f26743e/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982165%27 HTTP/1.1" 200 None
2026-03-25 22:51:33 [ayvens.be] INFO: Saving data for 1982165: {'created_time': 1774479093.894211, 'last_price_update_time': 1774479093.894221, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982165') HTTP/1.1" 204 0
2026-03-25 22:51:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:33 [ayvens.be] INFO: Found listing with ID: 1981160
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-25 22:51:33 [ayvens.be] INFO: Scrape type for 1981160: 2
2026-03-25 22:51:33 [ayvens.be] INFO: Extracting data for car ID: 1981160
2026-03-25 22:51:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-25 22:51:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 2
2026-03-25 22:51:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8921c252-c828-5ada-af84-a5834b0a35cf with scrape type 2
2026-03-25 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8921c252-c828-5ada-af84-a5834b0a35cf, identifier: 1981160
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b23627d10>
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/5.jpg saved to cache
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2150a610>
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F83af6185ec9a457f88947c70124f121d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/8.jpg saved to cache
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e478ec9f-310a-5a32-83e3-4dbef4d3230b
2026-03-25 22:51:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e478ec9f-310a-5a32-83e3-4dbef4d3230b, skipping ID generation
2026-03-25 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e478ec9f-310a-5a32-83e3-4dbef4d3230b with scrape type 1
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e478ec9f-310a-5a32-83e3-4dbef4d3230b sending to next pipeline
2026-03-25 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e478ec9f-310a-5a32-83e3-4dbef4d3230b, identifier: 1982164
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287490d0>
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F490a1408b9af45f0a8c8c68e9d7f6219%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/9.jpg saved to cache
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4574d2a-0e38-503a-83fb-300d5056238e
2026-03-25 22:51:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4574d2a-0e38-503a-83fb-300d5056238e, skipping ID generation
2026-03-25 22:51:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4574d2a-0e38-503a-83fb-300d5056238e with scrape type 1
2026-03-25 22:51:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4574d2a-0e38-503a-83fb-300d5056238e sending to next pipeline
2026-03-25 22:51:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4574d2a-0e38-503a-83fb-300d5056238e, identifier: 1982162
2026-03-25 22:51:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-25 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160
2026-03-25 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8921c252-c828-5ada-af84-a5834b0a35cf with identifier: 1981160 to the API
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8921c252-c828-5ada-af84-a5834b0a35cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON DIESEL - 2017',
 'odometer': 84412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON DIESEL - 2017 2.0 CR TDi Move! Ultimate DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi Move! Ultimate DSG',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981160%27 HTTP/1.1" 200 None
2026-03-25 22:51:34 [ayvens.be] INFO: Saving data for 1981160: {'auction_closing_time': 1774855800.0, 'created_time': 1774392370.035216, 'last_price_update_time': 1774479094.838646}
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981160') HTTP/1.1" 204 0
2026-03-25 22:51:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e478ec9f-310a-5a32-83e3-4dbef4d3230b with identifier: 1982164
2026-03-25 22:51:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e478ec9f-310a-5a32-83e3-4dbef4d3230b with identifier: 1982164
2026-03-25 22:51:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e478ec9f-310a-5a32-83e3-4dbef4d3230b with identifier: 1982164 to the API
2026-03-25 22:51:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e478ec9f-310a-5a32-83e3-4dbef4d3230b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 36618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478ec9f-310a-5a32-83e3-4dbef4d3230b/e478ec9f-310a-5a32-83e3-4dbef4d3230b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/83af6185ec9a457f88947c70124f121d/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982164%27 HTTP/1.1" 200 None
2026-03-25 22:51:35 [ayvens.be] INFO: Saving data for 1982164: {'created_time': 1774479095.153837, 'last_price_update_time': 1774479095.153848, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982164') HTTP/1.1" 204 0
2026-03-25 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4574d2a-0e38-503a-83fb-300d5056238e with identifier: 1982162
2026-03-25 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4574d2a-0e38-503a-83fb-300d5056238e with identifier: 1982162
2026-03-25 22:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4574d2a-0e38-503a-83fb-300d5056238e with identifier: 1982162 to the API
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c4574d2a-0e38-503a-83fb-300d5056238e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 62453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 766216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4574d2a-0e38-503a-83fb-300d5056238e/c4574d2a-0e38-503a-83fb-300d5056238e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/490a1408b9af45f0a8c8c68e9d7f6219/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982162%27 HTTP/1.1" 200 None
2026-03-25 22:51:35 [ayvens.be] INFO: Saving data for 1982162: {'created_time': 1774479095.47631, 'last_price_update_time': 1774479095.47632, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982162') HTTP/1.1" 204 0
2026-03-25 22:51:35 [ayvens.be] INFO: Found listing with ID: 1981161
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-25 22:51:35 [ayvens.be] INFO: Scrape type for 1981161: 2
2026-03-25 22:51:35 [ayvens.be] INFO: Extracting data for car ID: 1981161
2026-03-25 22:51:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-25 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 2
2026-03-25 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2fc17eb-8cc4-5060-a30b-08e075170d4d with scrape type 2
2026-03-25 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2fc17eb-8cc4-5060-a30b-08e075170d4d, identifier: 1981161
2026-03-25 22:51:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28bc7310>
2026-03-25 22:51:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_3.jpg HTTP/1.1" 201 0
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F7c507ac65d1e40769467893b28129bf3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/4.jpg saved to cache
2026-03-25 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b90c86a0-f470-5317-bf59-c52a5446e204
2026-03-25 22:51:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b90c86a0-f470-5317-bf59-c52a5446e204, skipping ID generation
2026-03-25 22:51:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90c86a0-f470-5317-bf59-c52a5446e204 with scrape type 1
2026-03-25 22:51:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b90c86a0-f470-5317-bf59-c52a5446e204 sending to next pipeline
2026-03-25 22:51:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b90c86a0-f470-5317-bf59-c52a5446e204, identifier: 1982160
2026-03-25 22:51:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-25 22:51:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161
2026-03-25 22:51:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2fc17eb-8cc4-5060-a30b-08e075170d4d with identifier: 1981161 to the API
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd2fc17eb-8cc4-5060-a30b-08e075170d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 60204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981161%27 HTTP/1.1" 200 None
2026-03-25 22:51:36 [ayvens.be] INFO: Saving data for 1981161: {'auction_closing_time': 1774855800.0, 'created_time': 1774392371.303155, 'last_price_update_time': 1774479096.062011}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981161') HTTP/1.1" 204 0
2026-03-25 22:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b90c86a0-f470-5317-bf59-c52a5446e204 with identifier: 1982160
2026-03-25 22:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b90c86a0-f470-5317-bf59-c52a5446e204 with identifier: 1982160
2026-03-25 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b90c86a0-f470-5317-bf59-c52a5446e204 with identifier: 1982160 to the API
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b90c86a0-f470-5317-bf59-c52a5446e204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 840969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b90c86a0-f470-5317-bf59-c52a5446e204/b90c86a0-f470-5317-bf59-c52a5446e204_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/7c507ac65d1e40769467893b28129bf3/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982160%27 HTTP/1.1" 200 None
2026-03-25 22:51:36 [ayvens.be] INFO: Saving data for 1982160: {'created_time': 1774479096.366806, 'last_price_update_time': 1774479096.366816, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982160') HTTP/1.1" 204 0
2026-03-25 22:51:36 [ayvens.be] INFO: Found listing with ID: 1981162
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-25 22:51:36 [ayvens.be] INFO: Scrape type for 1981162: 2
2026-03-25 22:51:36 [ayvens.be] INFO: Extracting data for car ID: 1981162
2026-03-25 22:51:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-25 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 2
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3768bda1-7314-5a71-83e5-60dfb18d6a21 with scrape type 2
2026-03-25 22:51:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3768bda1-7314-5a71-83e5-60dfb18d6a21, identifier: 1981162
2026-03-25 22:51:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-25 22:51:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162
2026-03-25 22:51:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3768bda1-7314-5a71-83e5-60dfb18d6a21 with identifier: 1981162 to the API
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3768bda1-7314-5a71-83e5-60dfb18d6a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI - 2020',
 'odometer': 125754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI - 2020 1.5 TSI Style',
 'transmission': 'manual',
 'trim': '1.5 TSI Style',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981162%27 HTTP/1.1" 200 None
2026-03-25 22:51:36 [ayvens.be] INFO: Saving data for 1981162: {'auction_closing_time': 1774855800.0, 'created_time': 1774392373.982268, 'last_price_update_time': 1774479096.73648}
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981162') HTTP/1.1" 204 0
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236afed0>
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_4.jpg HTTP/1.1" 201 0
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/5.jpg saved to cache
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b288c8cd0>
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6c4536d64d5b4e6481cc11bac53bc346%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/6.jpg saved to cache
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62
2026-03-25 22:51:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9168dc4c-03d1-5f7e-9981-4a0d77535f62, skipping ID generation
2026-03-25 22:51:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with scrape type 1
2026-03-25 22:51:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9168dc4c-03d1-5f7e-9981-4a0d77535f62 sending to next pipeline
2026-03-25 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9168dc4c-03d1-5f7e-9981-4a0d77535f62, identifier: 1982158
2026-03-25 22:51:37 [ayvens.be] INFO: Found listing with ID: 1981163
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-25 22:51:37 [ayvens.be] INFO: Scrape type for 1981163: 2
2026-03-25 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1981163
2026-03-25 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-25 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 2
2026-03-25 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 633de39c-557a-5914-acd1-c2a22f2cf2b7 with scrape type 2
2026-03-25 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 633de39c-557a-5914-acd1-c2a22f2cf2b7, identifier: 1981163
2026-03-25 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with identifier: 1982158
2026-03-25 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with identifier: 1982158
2026-03-25 22:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9168dc4c-03d1-5f7e-9981-4a0d77535f62 with identifier: 1982158 to the API
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '9168dc4c-03d1-5f7e-9981-4a0d77535f62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 87375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9168dc4c-03d1-5f7e-9981-4a0d77535f62/9168dc4c-03d1-5f7e-9981-4a0d77535f62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 936574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6c4536d64d5b4e6481cc11bac53bc346/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982158%27 HTTP/1.1" 200 None
2026-03-25 22:51:37 [ayvens.be] INFO: Saving data for 1982158: {'created_time': 1774479097.550532, 'last_price_update_time': 1774479097.550542, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982158') HTTP/1.1" 204 0
2026-03-25 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-25 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163
2026-03-25 22:51:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 633de39c-557a-5914-acd1-c2a22f2cf2b7 with identifier: 1981163 to the API
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '633de39c-557a-5914-acd1-c2a22f2cf2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 63981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 2.0 35 TDI S TRONIC QUATTRO',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC QUATTRO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981163%27 HTTP/1.1" 200 None
2026-03-25 22:51:37 [ayvens.be] INFO: Saving data for 1981163: {'auction_closing_time': 1774855800.0, 'created_time': 1774392375.101855, 'last_price_update_time': 1774479097.831978}
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981163') HTTP/1.1" 204 0
2026-03-25 22:51:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:37 [ayvens.be] INFO: Found listing with ID: 1981164
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-25 22:51:37 [ayvens.be] INFO: Scrape type for 1981164: 2
2026-03-25 22:51:37 [ayvens.be] INFO: Extracting data for car ID: 1981164
2026-03-25 22:51:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-25 22:51:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 2
2026-03-25 22:51:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea36366-becb-52d6-adf2-de44265f70ba with scrape type 2
2026-03-25 22:51:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ea36366-becb-52d6-adf2-de44265f70ba, identifier: 1981164
2026-03-25 22:51:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-25 22:51:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164
2026-03-25 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ea36366-becb-52d6-adf2-de44265f70ba with identifier: 1981164 to the API
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2ea36366-becb-52d6-adf2-de44265f70ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 42910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S GT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S GT',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981164%27 HTTP/1.1" 200 None
2026-03-25 22:51:38 [ayvens.be] INFO: Saving data for 1981164: {'auction_closing_time': 1774855800.0, 'created_time': 1774392376.659302, 'last_price_update_time': 1774479098.227068}
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981164') HTTP/1.1" 204 0
2026-03-25 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:38 [ayvens.be] INFO: Found listing with ID: 1981165
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-25 22:51:38 [ayvens.be] INFO: Scrape type for 1981165: 2
2026-03-25 22:51:38 [ayvens.be] INFO: Extracting data for car ID: 1981165
2026-03-25 22:51:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-25 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 2
2026-03-25 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with scrape type 2
2026-03-25 22:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0, identifier: 1981165
2026-03-25 22:51:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b2883ef90>
2026-03-25 22:51:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_5.jpg HTTP/1.1" 201 0
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fc160668822d14d76bc29134edd5dafa5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/6.jpg saved to cache
2026-03-25 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5
2026-03-25 22:51:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5, skipping ID generation
2026-03-25 22:51:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with scrape type 1
2026-03-25 22:51:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 sending to next pipeline
2026-03-25 22:51:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5, identifier: 1982157
2026-03-25 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-25 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165
2026-03-25 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86cae8a2-90d4-5ee6-8835-6f25660ee9f0 with identifier: 1981165 to the API
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '86cae8a2-90d4-5ee6-8835-6f25660ee9f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX',
 'odometer': 62278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX BEV 77KWH XDRIVE40',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH XDRIVE40',
 'vin': None,
 'year': 2023}
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981165%27 HTTP/1.1" 200 None
2026-03-25 22:51:38 [ayvens.be] INFO: Saving data for 1981165: {'auction_closing_time': 1774855800.0, 'created_time': 1774392378.632645, 'last_price_update_time': 1774479098.865059}
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981165') HTTP/1.1" 204 0
2026-03-25 22:51:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with identifier: 1982157
2026-03-25 22:51:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with identifier: 1982157
2026-03-25 22:51:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5 with identifier: 1982157 to the API
2026-03-25 22:51:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': '36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 49485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 960803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5/36a9b5f9-9cbf-51c5-b404-d7e3e11fe9f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 922255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/c160668822d14d76bc29134edd5dafa5/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982157%27 HTTP/1.1" 200 None
2026-03-25 22:51:39 [ayvens.be] INFO: Saving data for 1982157: {'created_time': 1774479099.19633, 'last_price_update_time': 1774479099.196342, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982157') HTTP/1.1" 204 0
2026-03-25 22:51:39 [ayvens.be] INFO: Found listing with ID: 1981166
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-25 22:51:39 [ayvens.be] INFO: Scrape type for 1981166: 2
2026-03-25 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1981166
2026-03-25 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-25 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 2
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82784532-457f-558d-bc1b-25ccb11a7de7 with scrape type 2
2026-03-25 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82784532-457f-558d-bc1b-25ccb11a7de7, identifier: 1981166
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28df9f90>
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/9.jpg saved to cache
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-25 22:51:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166
2026-03-25 22:51:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82784532-457f-558d-bc1b-25ccb11a7de7 with identifier: 1981166 to the API
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '82784532-457f-558d-bc1b-25ccb11a7de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 74098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 78KWH RECHARGE TWIN ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981166%27 HTTP/1.1" 200 None
2026-03-25 22:51:39 [ayvens.be] INFO: Saving data for 1981166: {'auction_closing_time': 1774855800.0, 'created_time': 1774392381.077474, 'last_price_update_time': 1774479099.708759}
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981166') HTTP/1.1" 204 0
2026-03-25 22:51:39 [ayvens.be] INFO: Found listing with ID: 1981167
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-25 22:51:39 [ayvens.be] INFO: Scrape type for 1981167: 2
2026-03-25 22:51:39 [ayvens.be] INFO: Extracting data for car ID: 1981167
2026-03-25 22:51:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-25 22:51:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 2
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26fb0bb8-171f-523e-a686-3a59b11a0599 with scrape type 2
2026-03-25 22:51:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26fb0bb8-171f-523e-a686-3a59b11a0599, identifier: 1981167
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b236f2dd0>
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/8.jpg saved to cache
2026-03-25 22:51:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a2f890>
2026-03-25 22:51:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/7.jpg saved to cache
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28a4dc50>
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_2.jpg HTTP/1.1" 201 0
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/3.jpg saved to cache
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-25 22:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167
2026-03-25 22:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26fb0bb8-171f-523e-a686-3a59b11a0599 with identifier: 1981167 to the API
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '26fb0bb8-171f-523e-a686-3a59b11a0599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 73894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW) Model Advantage Business',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW) Model Advantage Business',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981167%27 HTTP/1.1" 200 None
2026-03-25 22:51:40 [ayvens.be] INFO: Saving data for 1981167: {'auction_closing_time': 1774855800.0, 'created_time': 1774392382.620115, 'last_price_update_time': 1774479100.38295}
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981167') HTTP/1.1" 204 0
2026-03-25 22:51:40 [ayvens.be] INFO: Found listing with ID: 1981168
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-25 22:51:40 [ayvens.be] INFO: Scrape type for 1981168: 2
2026-03-25 22:51:40 [ayvens.be] INFO: Extracting data for car ID: 1981168
2026-03-25 22:51:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-25 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 2
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e06512cd-663b-5bfc-81eb-1250f1e387e6 with scrape type 2
2026-03-25 22:51:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e06512cd-663b-5bfc-81eb-1250f1e387e6, identifier: 1981168
2026-03-25 22:51:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-25 22:51:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168
2026-03-25 22:51:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e06512cd-663b-5bfc-81eb-1250f1e387e6 with identifier: 1981168 to the API
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e06512cd-663b-5bfc-81eb-1250f1e387e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 59559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'transmission': 'manual',
 'trim': '1.5 TURBO ECOTEC D 96KW S-S ULTIMATE',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981168%27 HTTP/1.1" 200 None
2026-03-25 22:51:40 [ayvens.be] INFO: Saving data for 1981168: {'auction_closing_time': 1774855800.0, 'created_time': 1774392384.256174, 'last_price_update_time': 1774479100.760487}
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981168') HTTP/1.1" 204 0
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28b7a6d0>
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_1.jpg HTTP/1.1" 201 0
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/2.jpg saved to cache
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b21508610>
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_0.jpg HTTP/1.1" 201 0
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252Fee5df36ae8a24c8294d4d21ce0f2023b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/1.jpg saved to cache
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4fab10c-7c75-56fc-a3ad-269be6cacd81
2026-03-25 22:51:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4fab10c-7c75-56fc-a3ad-269be6cacd81, skipping ID generation
2026-03-25 22:51:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fab10c-7c75-56fc-a3ad-269be6cacd81 with scrape type 1
2026-03-25 22:51:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4fab10c-7c75-56fc-a3ad-269be6cacd81 sending to next pipeline
2026-03-25 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d4fab10c-7c75-56fc-a3ad-269be6cacd81, identifier: 1982156
2026-03-25 22:51:41 [ayvens.be] INFO: Found listing with ID: 1981169
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-25 22:51:41 [ayvens.be] INFO: Scrape type for 1981169: 2
2026-03-25 22:51:41 [ayvens.be] INFO: Extracting data for car ID: 1981169
2026-03-25 22:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-25 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 2
2026-03-25 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with scrape type 2
2026-03-25 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bada9f12-e66f-5e16-8270-62c2bb7ec9f5, identifier: 1981169
2026-03-25 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d4fab10c-7c75-56fc-a3ad-269be6cacd81 with identifier: 1982156
2026-03-25 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d4fab10c-7c75-56fc-a3ad-269be6cacd81 with identifier: 1982156
2026-03-25 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d4fab10c-7c75-56fc-a3ad-269be6cacd81 with identifier: 1982156 to the API
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd4fab10c-7c75-56fc-a3ad-269be6cacd81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 35024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fab10c-7c75-56fc-a3ad-269be6cacd81/d4fab10c-7c75-56fc-a3ad-269be6cacd81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 796507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/ee5df36ae8a24c8294d4d21ce0f2023b/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982156%27 HTTP/1.1" 200 None
2026-03-25 22:51:41 [ayvens.be] INFO: Saving data for 1982156: {'created_time': 1774479101.493106, 'last_price_update_time': 1774479101.493115, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982156') HTTP/1.1" 204 0
2026-03-25 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-25 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169
2026-03-25 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bada9f12-e66f-5e16-8270-62c2bb7ec9f5 with identifier: 1981169 to the API
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bada9f12-e66f-5e16-8270-62c2bb7ec9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 73579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981169%27 HTTP/1.1" 200 None
2026-03-25 22:51:41 [ayvens.be] INFO: Saving data for 1981169: {'auction_closing_time': 1774855800.0, 'created_time': 1774392385.973873, 'last_price_update_time': 1774479101.74917}
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981169') HTTP/1.1" 204 0
2026-03-25 22:51:41 [ayvens.be] INFO: Found listing with ID: 1981170
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-25 22:51:41 [ayvens.be] INFO: Scrape type for 1981170: 2
2026-03-25 22:51:41 [ayvens.be] INFO: Extracting data for car ID: 1981170
2026-03-25 22:51:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-25 22:51:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 2
2026-03-25 22:51:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf74b177-c79e-5671-9cc0-4f2599309342 with scrape type 2
2026-03-25 22:51:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bf74b177-c79e-5671-9cc0-4f2599309342, identifier: 1981170
2026-03-25 22:51:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-25 22:51:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170
2026-03-25 22:51:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bf74b177-c79e-5671-9cc0-4f2599309342 with identifier: 1981170 to the API
2026-03-25 22:51:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bf74b177-c79e-5671-9cc0-4f2599309342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 58340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 35 TFSI (EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '35 TFSI (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981170%27 HTTP/1.1" 200 None
2026-03-25 22:51:42 [ayvens.be] INFO: Saving data for 1981170: {'auction_closing_time': 1774855800.0, 'created_time': 1774392387.442555, 'last_price_update_time': 1774479102.14033}
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981170') HTTP/1.1" 204 0
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815710>
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_9.jpg HTTP/1.1" 201 0
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/10.jpg saved to cache
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:51:42 [ayvens.be] INFO: Found listing with ID: 1981171
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-25 22:51:42 [ayvens.be] INFO: Scrape type for 1981171: 2
2026-03-25 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1981171
2026-03-25 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-25 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 2
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with scrape type 2
2026-03-25 22:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7, identifier: 1981171
2026-03-25 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-25 22:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171
2026-03-25 22:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02b95496-d32c-5b55-a5e2-4b6f41ff1ee7 with identifier: 1981171 to the API
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '02b95496-d32c-5b55-a5e2-4b6f41ff1ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'NX 300h - 2017',
 'odometer': 153802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS NX 300h - 2017 2.5i AWD Privilege Line E-CVT (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.5i AWD Privilege Line E-CVT (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981171%27 HTTP/1.1" 200 None
2026-03-25 22:51:42 [ayvens.be] INFO: Saving data for 1981171: {'auction_closing_time': 1774855800.0, 'created_time': 1774392390.736211, 'last_price_update_time': 1774479102.592311}
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981171') HTTP/1.1" 204 0
2026-03-25 22:51:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 22:51:42 [ayvens.be] INFO: Found listing with ID: 1981172
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-25 22:51:42 [ayvens.be] INFO: Scrape type for 1981172: 2
2026-03-25 22:51:42 [ayvens.be] INFO: Extracting data for car ID: 1981172
2026-03-25 22:51:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-25 22:51:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 2
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with scrape type 2
2026-03-25 22:51:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0, identifier: 1981172
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28815f10>
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_8.jpg HTTP/1.1" 201 0
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/9.jpg saved to cache
2026-03-25 22:51:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:51:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-25 22:51:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172
2026-03-25 22:51:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0 with identifier: 1981172 to the API
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'af82c574-4a37-5f1d-9ffb-8ed56ee5a5e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 75657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981172%27 HTTP/1.1" 200 None
2026-03-25 22:51:43 [ayvens.be] INFO: Saving data for 1981172: {'auction_closing_time': 1774855800.0, 'created_time': 1774392392.063078, 'last_price_update_time': 1774479103.08149}
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981172') HTTP/1.1" 204 0
2026-03-25 22:51:43 [ayvens.be] INFO: Found listing with ID: 1981173
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-25 22:51:43 [ayvens.be] INFO: Scrape type for 1981173: 2
2026-03-25 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1981173
2026-03-25 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-25 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 2
2026-03-25 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c25d1e4-4df3-555c-9e6e-3804b484e812 with scrape type 2
2026-03-25 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c25d1e4-4df3-555c-9e6e-3804b484e812, identifier: 1981173
2026-03-25 22:51:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b28742c90>
2026-03-25 22:51:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_6.jpg HTTP/1.1" 201 0
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/7.jpg saved to cache
2026-03-25 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-25 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173
2026-03-25 22:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c25d1e4-4df3-555c-9e6e-3804b484e812 with identifier: 1981173 to the API
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '8c25d1e4-4df3-555c-9e6e-3804b484e812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ESPACE',
 'odometer': 72455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ESPACE 2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '2.0 BLUE DCI 190 EDC INITIALE PARIS',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981173%27 HTTP/1.1" 200 None
2026-03-25 22:51:43 [ayvens.be] INFO: Saving data for 1981173: {'auction_closing_time': 1774855800.0, 'created_time': 1774392394.456033, 'last_price_update_time': 1774479103.611011}
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981173') HTTP/1.1" 204 0
2026-03-25 22:51:43 [ayvens.be] INFO: Found listing with ID: 1981174
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-25 22:51:43 [ayvens.be] INFO: Scrape type for 1981174: 2
2026-03-25 22:51:43 [ayvens.be] INFO: Extracting data for car ID: 1981174
2026-03-25 22:51:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-25 22:51:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 2
2026-03-25 22:51:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ac70e37-7aff-5307-9289-11c93460ae8a with scrape type 2
2026-03-25 22:51:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ac70e37-7aff-5307-9289-11c93460ae8a, identifier: 1981174
2026-03-25 22:51:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-25 22:51:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174
2026-03-25 22:51:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0ac70e37-7aff-5307-9289-11c93460ae8a with identifier: 1981174 to the API
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '0ac70e37-7aff-5307-9289-11c93460ae8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 64706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981174%27 HTTP/1.1" 200 None
2026-03-25 22:51:44 [ayvens.be] INFO: Saving data for 1981174: {'auction_closing_time': 1774855800.0, 'created_time': 1774392396.048972, 'last_price_update_time': 1774479104.089494}
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981174') HTTP/1.1" 204 0
2026-03-25 22:51:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 22:51:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b287437d0>
2026-03-25 22:51:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 22:51:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_7.jpg HTTP/1.1" 201 0
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F744b27286a954e6583b0d4f1d8df2ffd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-03-25 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/8.jpg saved to cache
2026-03-25 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab4ee28b-2ba1-5751-897f-eb30ad612da4
2026-03-25 22:51:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab4ee28b-2ba1-5751-897f-eb30ad612da4, skipping ID generation
2026-03-25 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab4ee28b-2ba1-5751-897f-eb30ad612da4 with scrape type 1
2026-03-25 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab4ee28b-2ba1-5751-897f-eb30ad612da4 sending to next pipeline
2026-03-25 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab4ee28b-2ba1-5751-897f-eb30ad612da4, identifier: 1982155
2026-03-25 22:51:44 [ayvens.be] INFO: Found listing with ID: 1981175
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-25 22:51:44 [ayvens.be] INFO: Scrape type for 1981175: 2
2026-03-25 22:51:44 [ayvens.be] INFO: Extracting data for car ID: 1981175
2026-03-25 22:51:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-25 22:51:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 2
2026-03-25 22:51:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 331bba43-88fa-5fd6-bc58-c262b85e16e4 with scrape type 2
2026-03-25 22:51:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 331bba43-88fa-5fd6-bc58-c262b85e16e4, identifier: 1981175
2026-03-25 22:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab4ee28b-2ba1-5751-897f-eb30ad612da4 with identifier: 1982155
2026-03-25 22:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab4ee28b-2ba1-5751-897f-eb30ad612da4 with identifier: 1982155
2026-03-25 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab4ee28b-2ba1-5751-897f-eb30ad612da4 with identifier: 1982155 to the API
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-04-01T10:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab4ee28b-2ba1-5751-897f-eb30ad612da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41006',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 67778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 901137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 864233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab4ee28b-2ba1-5751-897f-eb30ad612da4/ab4ee28b-2ba1-5751-897f-eb30ad612da4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/744b27286a954e6583b0d4f1d8df2ffd/images/large/10.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271982155%27 HTTP/1.1" 200 None
2026-03-25 22:51:44 [ayvens.be] INFO: Saving data for 1982155: {'created_time': 1774479104.770534, 'last_price_update_time': 1774479104.770547, 'auction_closing_time': 1775037600.0}
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1982155') HTTP/1.1" 204 0
2026-03-25 22:51:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-25 22:51:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175
2026-03-25 22:51:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 331bba43-88fa-5fd6-bc58-c262b85e16e4 with identifier: 1981175 to the API
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '331bba43-88fa-5fd6-bc58-c262b85e16e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 175527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981175%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Saving data for 1981175: {'auction_closing_time': 1774855800.0, 'created_time': 1774392398.035845, 'last_price_update_time': 1774479105.051625}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981175') HTTP/1.1" 204 0
2026-03-25 22:51:45 [ayvens.be] INFO: Found listing with ID: 1981176
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Scrape type for 1981176: 2
2026-03-25 22:51:45 [ayvens.be] INFO: Extracting data for car ID: 1981176
2026-03-25 22:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-25 22:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17214413-005d-58d6-88eb-3901260b89d0 with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17214413-005d-58d6-88eb-3901260b89d0, identifier: 1981176
2026-03-25 22:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-25 22:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176
2026-03-25 22:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17214413-005d-58d6-88eb-3901260b89d0 with identifier: 1981176 to the API
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '17214413-005d-58d6-88eb-3901260b89d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS7 CROSSBACK DIESEL',
 'odometer': 68115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS7 CROSSBACK DIESEL 1.5 BlueHDi Performance Line '
          '(EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Performance Line (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981176%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Saving data for 1981176: {'auction_closing_time': 1774855800.0, 'created_time': 1774392401.041871, 'last_price_update_time': 1774479105.415574}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981176') HTTP/1.1" 204 0
2026-03-25 22:51:45 [ayvens.be] INFO: Found listing with ID: 1981177
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Scrape type for 1981177: 2
2026-03-25 22:51:45 [ayvens.be] INFO: Extracting data for car ID: 1981177
2026-03-25 22:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-25 22:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2b3553c-9c84-5edb-8824-6696ed4b72ca with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2b3553c-9c84-5edb-8824-6696ed4b72ca, identifier: 1981177
2026-03-25 22:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-25 22:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177
2026-03-25 22:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2b3553c-9c84-5edb-8824-6696ed4b72ca with identifier: 1981177 to the API
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a2b3553c-9c84-5edb-8824-6696ed4b72ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 97573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.5 TDCI 88KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981177%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Saving data for 1981177: {'auction_closing_time': 1774855800.0, 'created_time': 1774392402.530933, 'last_price_update_time': 1774479105.797721}
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981177') HTTP/1.1" 204 0
2026-03-25 22:51:45 [ayvens.be] INFO: Found listing with ID: 1981178
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-25 22:51:45 [ayvens.be] INFO: Scrape type for 1981178: 2
2026-03-25 22:51:45 [ayvens.be] INFO: Extracting data for car ID: 1981178
2026-03-25 22:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-25 22:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4409a9-9ad5-5493-9e2c-50833909d336 with scrape type 2
2026-03-25 22:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a4409a9-9ad5-5493-9e2c-50833909d336, identifier: 1981178
2026-03-25 22:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-25 22:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178
2026-03-25 22:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a4409a9-9ad5-5493-9e2c-50833909d336 with identifier: 1981178 to the API
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7a4409a9-9ad5-5493-9e2c-50833909d336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU SWB DSL -',
 'odometer': 91397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU SWB DSL - 2.0 TDi SCR BMT STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR BMT STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981178%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Saving data for 1981178: {'auction_closing_time': 1774855800.0, 'created_time': 1774392404.029869, 'last_price_update_time': 1774479106.174901}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981178') HTTP/1.1" 204 0
2026-03-25 22:51:46 [ayvens.be] INFO: Found listing with ID: 1981179
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Scrape type for 1981179: 2
2026-03-25 22:51:46 [ayvens.be] INFO: Extracting data for car ID: 1981179
2026-03-25 22:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-25 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 2
2026-03-25 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c56e558d-f409-5e26-a03f-a3ce35464bb6 with scrape type 2
2026-03-25 22:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c56e558d-f409-5e26-a03f-a3ce35464bb6, identifier: 1981179
2026-03-25 22:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-25 22:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179
2026-03-25 22:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c56e558d-f409-5e26-a03f-a3ce35464bb6 with identifier: 1981179 to the API
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c56e558d-f409-5e26-a03f-a3ce35464bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981179%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Saving data for 1981179: {'auction_closing_time': 1774855800.0, 'created_time': 1774392405.447877, 'last_price_update_time': 1774479106.557551}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981179') HTTP/1.1" 204 0
2026-03-25 22:51:46 [ayvens.be] INFO: Found listing with ID: 1981180
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Scrape type for 1981180: 2
2026-03-25 22:51:46 [ayvens.be] INFO: Extracting data for car ID: 1981180
2026-03-25 22:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-25 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 2
2026-03-25 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with scrape type 2
2026-03-25 22:51:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3, identifier: 1981180
2026-03-25 22:51:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-25 22:51:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180
2026-03-25 22:51:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63b06c4f-b3e4-52db-b6d0-71fd8b18aee3 with identifier: 1981180 to the API
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '63b06c4f-b3e4-52db-b6d0-71fd8b18aee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB DIESEL - 2019',
 'odometer': 162489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB DIESEL - 2019 1.6 CR TDi Style DSG',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Style DSG',
 'vin': None,
 'year': 2019}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981180%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Saving data for 1981180: {'auction_closing_time': 1774855800.0, 'created_time': 1774392406.994496, 'last_price_update_time': 1774479106.928405}
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981180') HTTP/1.1" 204 0
2026-03-25 22:51:46 [ayvens.be] INFO: Found listing with ID: 1981181
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-25 22:51:46 [ayvens.be] INFO: Scrape type for 1981181: 2
2026-03-25 22:51:46 [ayvens.be] INFO: Extracting data for car ID: 1981181
2026-03-25 22:51:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-25 22:51:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 2
2026-03-25 22:51:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc105ddb-de53-57db-9a21-f647522a6943 with scrape type 2
2026-03-25 22:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc105ddb-de53-57db-9a21-f647522a6943, identifier: 1981181
2026-03-25 22:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-25 22:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181
2026-03-25 22:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc105ddb-de53-57db-9a21-f647522a6943 with identifier: 1981181 to the API
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bc105ddb-de53-57db-9a21-f647522a6943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 28223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 ESSENTIAL LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 B 180 ESSENTIAL LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981181%27 HTTP/1.1" 200 None
2026-03-25 22:51:47 [ayvens.be] INFO: Saving data for 1981181: {'auction_closing_time': 1774855800.0, 'created_time': 1774392408.617494, 'last_price_update_time': 1774479107.293165}
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981181') HTTP/1.1" 204 0
2026-03-25 22:51:47 [ayvens.be] INFO: Found listing with ID: 1981182
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-25 22:51:47 [ayvens.be] INFO: Scrape type for 1981182: 2
2026-03-25 22:51:47 [ayvens.be] INFO: Extracting data for car ID: 1981182
2026-03-25 22:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-25 22:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 2
2026-03-25 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7aceaaa9-c92a-515d-ba6b-e81b502da630 with scrape type 2
2026-03-25 22:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7aceaaa9-c92a-515d-ba6b-e81b502da630, identifier: 1981182
2026-03-25 22:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-25 22:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182
2026-03-25 22:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7aceaaa9-c92a-515d-ba6b-e81b502da630 with identifier: 1981182 to the API
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '7aceaaa9-c92a-515d-ba6b-e81b502da630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 124706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR ADV BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981182%27 HTTP/1.1" 200 None
2026-03-25 22:51:47 [ayvens.be] INFO: Saving data for 1981182: {'auction_closing_time': 1774855800.0, 'created_time': 1774392410.621697, 'last_price_update_time': 1774479107.689764}
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981182') HTTP/1.1" 204 0
2026-03-25 22:51:47 [ayvens.be] INFO: Found listing with ID: 1981183
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-25 22:51:47 [ayvens.be] INFO: Scrape type for 1981183: 2
2026-03-25 22:51:47 [ayvens.be] INFO: Extracting data for car ID: 1981183
2026-03-25 22:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-25 22:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 2
2026-03-25 22:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59b6a74b-2362-54af-9350-d76aac1792fd with scrape type 2
2026-03-25 22:51:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59b6a74b-2362-54af-9350-d76aac1792fd, identifier: 1981183
2026-03-25 22:51:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-25 22:51:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183
2026-03-25 22:51:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 59b6a74b-2362-54af-9350-d76aac1792fd with identifier: 1981183 to the API
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '59b6a74b-2362-54af-9350-d76aac1792fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500 - 2015',
 'odometer': 76076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 - 2015 1.0i MHEV Lounge',
 'transmission': 'manual',
 'trim': '1.0i MHEV Lounge',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981183%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Saving data for 1981183: {'auction_closing_time': 1774855800.0, 'created_time': 1774392411.942653, 'last_price_update_time': 1774479108.06671}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981183') HTTP/1.1" 204 0
2026-03-25 22:51:48 [ayvens.be] INFO: Found listing with ID: 1981184
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Scrape type for 1981184: 2
2026-03-25 22:51:48 [ayvens.be] INFO: Extracting data for car ID: 1981184
2026-03-25 22:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-25 22:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 2
2026-03-25 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with scrape type 2
2026-03-25 22:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e, identifier: 1981184
2026-03-25 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-25 22:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184
2026-03-25 22:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e with identifier: 1981184 to the API
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '67cbb5a5-1e4b-5774-a9c0-45ad41c3f46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 DIESEL - 2017',
 'odometer': 87500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 DIESEL - 2017 1.5 BlueHDi Active (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active (EU6.2)',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981184%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Saving data for 1981184: {'auction_closing_time': 1774855800.0, 'created_time': 1774392414.479355, 'last_price_update_time': 1774479108.439595}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981184') HTTP/1.1" 204 0
2026-03-25 22:51:48 [ayvens.be] INFO: Found listing with ID: 1981185
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Scrape type for 1981185: 2
2026-03-25 22:51:48 [ayvens.be] INFO: Extracting data for car ID: 1981185
2026-03-25 22:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-25 22:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 2
2026-03-25 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882573fb-1930-56f8-ac29-e5d6c092958b with scrape type 2
2026-03-25 22:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 882573fb-1930-56f8-ac29-e5d6c092958b, identifier: 1981185
2026-03-25 22:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-25 22:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185
2026-03-25 22:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 882573fb-1930-56f8-ac29-e5d6c092958b with identifier: 1981185 to the API
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '882573fb-1930-56f8-ac29-e5d6c092958b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 79199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216I ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216I ACTIVE TOURER',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981185%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Saving data for 1981185: {'auction_closing_time': 1774855800.0, 'created_time': 1774392415.44941, 'last_price_update_time': 1774479108.908499}
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981185') HTTP/1.1" 204 0
2026-03-25 22:51:48 [ayvens.be] INFO: Found listing with ID: 1981186
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-25 22:51:48 [ayvens.be] INFO: Scrape type for 1981186: 2
2026-03-25 22:51:48 [ayvens.be] INFO: Extracting data for car ID: 1981186
2026-03-25 22:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-25 22:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 2
2026-03-25 22:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cfc13c-7357-50e4-9a81-496fc7f2697f with scrape type 2
2026-03-25 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8cfc13c-7357-50e4-9a81-496fc7f2697f, identifier: 1981186
2026-03-25 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-25 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186
2026-03-25 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c8cfc13c-7357-50e4-9a81-496fc7f2697f with identifier: 1981186 to the API
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c8cfc13c-7357-50e4-9a81-496fc7f2697f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 78402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS ED SPORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981186%27 HTTP/1.1" 200 None
2026-03-25 22:51:49 [ayvens.be] INFO: Saving data for 1981186: {'auction_closing_time': 1774855800.0, 'created_time': 1774392416.496681, 'last_price_update_time': 1774479109.273728}
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981186') HTTP/1.1" 204 0
2026-03-25 22:51:49 [ayvens.be] INFO: Found listing with ID: 1981187
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-25 22:51:49 [ayvens.be] INFO: Scrape type for 1981187: 2
2026-03-25 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1981187
2026-03-25 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-25 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 2
2026-03-25 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72a7c77-b267-5998-b7cd-188d4962645c with scrape type 2
2026-03-25 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a72a7c77-b267-5998-b7cd-188d4962645c, identifier: 1981187
2026-03-25 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-25 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187
2026-03-25 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a72a7c77-b267-5998-b7cd-188d4962645c with identifier: 1981187 to the API
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'a72a7c77-b267-5998-b7cd-188d4962645c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 109261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981187%27 HTTP/1.1" 200 None
2026-03-25 22:51:49 [ayvens.be] INFO: Saving data for 1981187: {'auction_closing_time': 1774855800.0, 'created_time': 1774392418.711801, 'last_price_update_time': 1774479109.658579}
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981187') HTTP/1.1" 204 0
2026-03-25 22:51:49 [ayvens.be] INFO: Found listing with ID: 1981188
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-25 22:51:49 [ayvens.be] INFO: Scrape type for 1981188: 2
2026-03-25 22:51:49 [ayvens.be] INFO: Extracting data for car ID: 1981188
2026-03-25 22:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-25 22:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 2
2026-03-25 22:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a002bfd-a915-531e-b05e-d40568f19197 with scrape type 2
2026-03-25 22:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9a002bfd-a915-531e-b05e-d40568f19197, identifier: 1981188
2026-03-25 22:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-25 22:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188
2026-03-25 22:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9a002bfd-a915-531e-b05e-d40568f19197 with identifier: 1981188 to the API
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9a002bfd-a915-531e-b05e-d40568f19197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 23776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA 1.0 TSI 85KW DSG CORPORATE',
 'transmission': 'automatic',
 'trim': '1.0 TSI 85KW DSG CORPORATE',
 'vin': None,
 'year': 2024}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981188%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Saving data for 1981188: {'auction_closing_time': 1774855800.0, 'created_time': 1774392421.164786, 'last_price_update_time': 1774479110.031998}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981188') HTTP/1.1" 204 0
2026-03-25 22:51:50 [ayvens.be] INFO: Found listing with ID: 1981189
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Scrape type for 1981189: 2
2026-03-25 22:51:50 [ayvens.be] INFO: Extracting data for car ID: 1981189
2026-03-25 22:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-25 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 2
2026-03-25 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16158bbe-f025-5494-907d-ec6a1d3f8c66 with scrape type 2
2026-03-25 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16158bbe-f025-5494-907d-ec6a1d3f8c66, identifier: 1981189
2026-03-25 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-25 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189
2026-03-25 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16158bbe-f025-5494-907d-ec6a1d3f8c66 with identifier: 1981189 to the API
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '16158bbe-f025-5494-907d-ec6a1d3f8c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 72213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981189%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Saving data for 1981189: {'auction_closing_time': 1774855800.0, 'created_time': 1774392422.361461, 'last_price_update_time': 1774479110.392365}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981189') HTTP/1.1" 204 0
2026-03-25 22:51:50 [ayvens.be] INFO: Found listing with ID: 1981190
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Scrape type for 1981190: 2
2026-03-25 22:51:50 [ayvens.be] INFO: Extracting data for car ID: 1981190
2026-03-25 22:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-25 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 2
2026-03-25 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with scrape type 2
2026-03-25 22:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d, identifier: 1981190
2026-03-25 22:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-25 22:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190
2026-03-25 22:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d90bae9-76bb-55ed-8860-c28c42a7ee2d with identifier: 1981190 to the API
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d90bae9-76bb-55ed-8860-c28c42a7ee2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 57971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981190%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Saving data for 1981190: {'auction_closing_time': 1774855800.0, 'created_time': 1774392423.886259, 'last_price_update_time': 1774479110.848254}
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981190') HTTP/1.1" 204 0
2026-03-25 22:51:50 [ayvens.be] INFO: Found listing with ID: 1981191
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-25 22:51:50 [ayvens.be] INFO: Scrape type for 1981191: 2
2026-03-25 22:51:50 [ayvens.be] INFO: Extracting data for car ID: 1981191
2026-03-25 22:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-25 22:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 2
2026-03-25 22:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe091a10-bfdc-5d3f-8236-47195332ac34 with scrape type 2
2026-03-25 22:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe091a10-bfdc-5d3f-8236-47195332ac34, identifier: 1981191
2026-03-25 22:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-25 22:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191
2026-03-25 22:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe091a10-bfdc-5d3f-8236-47195332ac34 with identifier: 1981191 to the API
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe091a10-bfdc-5d3f-8236-47195332ac34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 32910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.0 T-GDI MHEV PULSE DCT",
 'transmission': 'automatic',
 'trim': '1.0 T-GDI MHEV PULSE DCT',
 'vin': None,
 'year': 2024}
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981191%27 HTTP/1.1" 200 None
2026-03-25 22:51:51 [ayvens.be] INFO: Saving data for 1981191: {'auction_closing_time': 1774855800.0, 'created_time': 1774392425.882338, 'last_price_update_time': 1774479111.327074}
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981191') HTTP/1.1" 204 0
2026-03-25 22:51:51 [ayvens.be] INFO: Found listing with ID: 1981192
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-25 22:51:51 [ayvens.be] INFO: Scrape type for 1981192: 2
2026-03-25 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1981192
2026-03-25 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-25 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 2
2026-03-25 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00dbba5e-e47b-5613-9827-74f622da8956 with scrape type 2
2026-03-25 22:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00dbba5e-e47b-5613-9827-74f622da8956, identifier: 1981192
2026-03-25 22:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-25 22:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192
2026-03-25 22:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00dbba5e-e47b-5613-9827-74f622da8956 with identifier: 1981192 to the API
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '00dbba5e-e47b-5613-9827-74f622da8956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'ABARTH',
 'model': '500',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'ABARTH 500 1.4 T-JET 595',
 'transmission': 'manual',
 'trim': '1.4 T-JET 595',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981192%27 HTTP/1.1" 200 None
2026-03-25 22:51:51 [ayvens.be] INFO: Saving data for 1981192: {'auction_closing_time': 1774855800.0, 'created_time': 1774392428.370271, 'last_price_update_time': 1774479111.686488}
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981192') HTTP/1.1" 204 0
2026-03-25 22:51:51 [ayvens.be] INFO: Found listing with ID: 1981193
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-25 22:51:51 [ayvens.be] INFO: Scrape type for 1981193: 2
2026-03-25 22:51:51 [ayvens.be] INFO: Extracting data for car ID: 1981193
2026-03-25 22:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-25 22:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 2
2026-03-25 22:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57c50d68-de83-5965-b7b6-58c456a320f5 with scrape type 2
2026-03-25 22:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 57c50d68-de83-5965-b7b6-58c456a320f5, identifier: 1981193
2026-03-25 22:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-25 22:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193
2026-03-25 22:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 57c50d68-de83-5965-b7b6-58c456a320f5 with identifier: 1981193 to the API
2026-03-25 22:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '57c50d68-de83-5965-b7b6-58c456a320f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 114618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981193%27 HTTP/1.1" 200 None
2026-03-25 22:51:52 [ayvens.be] INFO: Saving data for 1981193: {'auction_closing_time': 1774855800.0, 'created_time': 1774392430.847746, 'last_price_update_time': 1774479112.997685}
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981193') HTTP/1.1" 204 0
2026-03-25 22:51:53 [ayvens.be] INFO: Found listing with ID: 1981194
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-25 22:51:53 [ayvens.be] INFO: Scrape type for 1981194: 2
2026-03-25 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1981194
2026-03-25 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-25 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f, identifier: 1981194
2026-03-25 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-25 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194
2026-03-25 22:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 48c868ee-daee-58ba-aa22-9ccc0cb5cf9f with identifier: 1981194 to the API
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '48c868ee-daee-58ba-aa22-9ccc0cb5cf9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BERLINE',
 'odometer': 86429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BERLINE 1.6 E 200 D BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '1.6 E 200 D BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981194%27 HTTP/1.1" 200 None
2026-03-25 22:51:53 [ayvens.be] INFO: Saving data for 1981194: {'auction_closing_time': 1774855800.0, 'created_time': 1774392433.170293, 'last_price_update_time': 1774479113.395146}
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981194') HTTP/1.1" 204 0
2026-03-25 22:51:53 [ayvens.be] INFO: Found listing with ID: 1981195
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-25 22:51:53 [ayvens.be] INFO: Scrape type for 1981195: 2
2026-03-25 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1981195
2026-03-25 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-25 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bea68af-8c20-5867-a11f-bdf142cff75a with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bea68af-8c20-5867-a11f-bdf142cff75a, identifier: 1981195
2026-03-25 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-25 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195
2026-03-25 22:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bea68af-8c20-5867-a11f-bdf142cff75a with identifier: 1981195 to the API
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4bea68af-8c20-5867-a11f-bdf142cff75a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 80642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.5 BLUEHDI 130 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981195%27 HTTP/1.1" 200 None
2026-03-25 22:51:53 [ayvens.be] INFO: Saving data for 1981195: {'auction_closing_time': 1774855800.0, 'created_time': 1774392435.435781, 'last_price_update_time': 1774479113.776595}
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981195') HTTP/1.1" 204 0
2026-03-25 22:51:53 [ayvens.be] INFO: Found listing with ID: 1981196
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-25 22:51:53 [ayvens.be] INFO: Scrape type for 1981196: 2
2026-03-25 22:51:53 [ayvens.be] INFO: Extracting data for car ID: 1981196
2026-03-25 22:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-25 22:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a506822-a73a-5c8a-add2-85e191767713 with scrape type 2
2026-03-25 22:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a506822-a73a-5c8a-add2-85e191767713, identifier: 1981196
2026-03-25 22:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-25 22:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196
2026-03-25 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a506822-a73a-5c8a-add2-85e191767713 with identifier: 1981196 to the API
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a506822-a73a-5c8a-add2-85e191767713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 68376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'automatic',
 'trim': '1.3 GLB 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981196%27 HTTP/1.1" 200 None
2026-03-25 22:51:54 [ayvens.be] INFO: Saving data for 1981196: {'auction_closing_time': 1774855800.0, 'created_time': 1774392437.036631, 'last_price_update_time': 1774479114.234362}
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981196') HTTP/1.1" 204 0
2026-03-25 22:51:54 [ayvens.be] INFO: Found listing with ID: 1981197
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-25 22:51:54 [ayvens.be] INFO: Scrape type for 1981197: 2
2026-03-25 22:51:54 [ayvens.be] INFO: Extracting data for car ID: 1981197
2026-03-25 22:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-25 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 2
2026-03-25 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34bbce84-f627-506c-82ba-5e794d52266e with scrape type 2
2026-03-25 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34bbce84-f627-506c-82ba-5e794d52266e, identifier: 1981197
2026-03-25 22:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-25 22:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197
2026-03-25 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34bbce84-f627-506c-82ba-5e794d52266e with identifier: 1981197 to the API
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '34bbce84-f627-506c-82ba-5e794d52266e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 TOURING - 2019',
 'odometer': 99279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 TOURING - 2019 318iA OPF',
 'transmission': 'automatic',
 'trim': '318iA OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981197%27 HTTP/1.1" 200 None
2026-03-25 22:51:54 [ayvens.be] INFO: Saving data for 1981197: {'auction_closing_time': 1774855800.0, 'created_time': 1774392440.643883, 'last_price_update_time': 1774479114.630526}
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981197') HTTP/1.1" 204 0
2026-03-25 22:51:54 [ayvens.be] INFO: Found listing with ID: 1981198
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-25 22:51:54 [ayvens.be] INFO: Scrape type for 1981198: 2
2026-03-25 22:51:54 [ayvens.be] INFO: Extracting data for car ID: 1981198
2026-03-25 22:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-25 22:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 2
2026-03-25 22:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b12c27-b446-504a-96f4-31499a06ea19 with scrape type 2
2026-03-25 22:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 05b12c27-b446-504a-96f4-31499a06ea19, identifier: 1981198
2026-03-25 22:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-25 22:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198
2026-03-25 22:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 05b12c27-b446-504a-96f4-31499a06ea19 with identifier: 1981198 to the API
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '05b12c27-b446-504a-96f4-31499a06ea19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 83734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981198%27 HTTP/1.1" 200 None
2026-03-25 22:51:54 [ayvens.be] INFO: Saving data for 1981198: {'auction_closing_time': 1774855800.0, 'created_time': 1774392441.927994, 'last_price_update_time': 1774479114.993014}
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981198') HTTP/1.1" 204 0
2026-03-25 22:51:55 [ayvens.be] INFO: Found listing with ID: 1981199
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-25 22:51:55 [ayvens.be] INFO: Scrape type for 1981199: 2
2026-03-25 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1981199
2026-03-25 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-25 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1774da05-df84-53e8-b1ea-548cacdfce92 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1774da05-df84-53e8-b1ea-548cacdfce92, identifier: 1981199
2026-03-25 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-25 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199
2026-03-25 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1774da05-df84-53e8-b1ea-548cacdfce92 with identifier: 1981199 to the API
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '1774da05-df84-53e8-b1ea-548cacdfce92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 330E (215KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 330E (215KW) TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981199%27 HTTP/1.1" 200 None
2026-03-25 22:51:55 [ayvens.be] INFO: Saving data for 1981199: {'auction_closing_time': 1774855800.0, 'created_time': 1774392443.333041, 'last_price_update_time': 1774479115.359013}
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981199') HTTP/1.1" 204 0
2026-03-25 22:51:55 [ayvens.be] INFO: Found listing with ID: 1981200
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-25 22:51:55 [ayvens.be] INFO: Scrape type for 1981200: 2
2026-03-25 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1981200
2026-03-25 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-25 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14, identifier: 1981200
2026-03-25 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-25 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200
2026-03-25 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14 with identifier: 1981200 to the API
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ff0844ab-9dc1-5c70-9ffb-b8abaa1d6b14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 93886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981200%27 HTTP/1.1" 200 None
2026-03-25 22:51:55 [ayvens.be] INFO: Saving data for 1981200: {'auction_closing_time': 1774855800.0, 'created_time': 1774392445.185101, 'last_price_update_time': 1774479115.74177}
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981200') HTTP/1.1" 204 0
2026-03-25 22:51:55 [ayvens.be] INFO: Found listing with ID: 1981201
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-25 22:51:55 [ayvens.be] INFO: Scrape type for 1981201: 2
2026-03-25 22:51:55 [ayvens.be] INFO: Extracting data for car ID: 1981201
2026-03-25 22:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-25 22:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with scrape type 2
2026-03-25 22:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6, identifier: 1981201
2026-03-25 22:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-25 22:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201
2026-03-25 22:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6 with identifier: 1981201 to the API
2026-03-25 22:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb5dfb7-32a9-5b22-ac1f-7d343fecb5a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 - 2018',
 'odometer': 80523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 - 2018 2.0 T6 AWD PHEV Inscription Expression',
 'transmission': 'automatic',
 'trim': '2.0 T6 AWD PHEV Inscription Expression',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981201%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Saving data for 1981201: {'auction_closing_time': 1774855800.0, 'created_time': 1774392446.749302, 'last_price_update_time': 1774479116.139072}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981201') HTTP/1.1" 204 0
2026-03-25 22:51:56 [ayvens.be] INFO: Found listing with ID: 1981202
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Scrape type for 1981202: 2
2026-03-25 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1981202
2026-03-25 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-25 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 2
2026-03-25 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with scrape type 2
2026-03-25 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8, identifier: 1981202
2026-03-25 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-25 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202
2026-03-25 22:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8 with identifier: 1981202 to the API
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'd04fe0eb-3956-5e57-bdbc-cf8f45ac5cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 79813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981202%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Saving data for 1981202: {'auction_closing_time': 1774855800.0, 'created_time': 1774392448.046199, 'last_price_update_time': 1774479116.554682}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981202') HTTP/1.1" 204 0
2026-03-25 22:51:56 [ayvens.be] INFO: Found listing with ID: 1981203
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Scrape type for 1981203: 2
2026-03-25 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1981203
2026-03-25 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-25 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 2
2026-03-25 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 005dbb32-469c-5d45-ba42-34d252124796 with scrape type 2
2026-03-25 22:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 005dbb32-469c-5d45-ba42-34d252124796, identifier: 1981203
2026-03-25 22:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-25 22:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203
2026-03-25 22:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 005dbb32-469c-5d45-ba42-34d252124796 with identifier: 1981203 to the API
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '005dbb32-469c-5d45-ba42-34d252124796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS BREAK',
 'odometer': 149159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS BREAK 2.0 C 300 E BUSINESS SOLUTION AUTO',
 'transmission': 'automatic',
 'trim': '2.0 C 300 E BUSINESS SOLUTION AUTO',
 'vin': None,
 'year': 2020}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981203%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Saving data for 1981203: {'auction_closing_time': 1774855800.0, 'created_time': 1774392450.357066, 'last_price_update_time': 1774479116.938043}
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981203') HTTP/1.1" 204 0
2026-03-25 22:51:56 [ayvens.be] INFO: Found listing with ID: 1981204
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-25 22:51:56 [ayvens.be] INFO: Scrape type for 1981204: 2
2026-03-25 22:51:56 [ayvens.be] INFO: Extracting data for car ID: 1981204
2026-03-25 22:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-25 22:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 2
2026-03-25 22:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with scrape type 2
2026-03-25 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d, identifier: 1981204
2026-03-25 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-25 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204
2026-03-25 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4a976dcd-9bb9-53e0-8d92-ebc8af6a984d with identifier: 1981204 to the API
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '4a976dcd-9bb9-53e0-8d92-ebc8af6a984d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 77490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981204%27 HTTP/1.1" 200 None
2026-03-25 22:51:57 [ayvens.be] INFO: Saving data for 1981204: {'auction_closing_time': 1774855800.0, 'created_time': 1774392451.848277, 'last_price_update_time': 1774479117.322541}
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981204') HTTP/1.1" 204 0
2026-03-25 22:51:57 [ayvens.be] INFO: Found listing with ID: 1981205
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-25 22:51:57 [ayvens.be] INFO: Scrape type for 1981205: 2
2026-03-25 22:51:57 [ayvens.be] INFO: Extracting data for car ID: 1981205
2026-03-25 22:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-25 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 2
2026-03-25 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 928ce10f-74ef-57ff-b729-f4a26d193dc0 with scrape type 2
2026-03-25 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 928ce10f-74ef-57ff-b729-f4a26d193dc0, identifier: 1981205
2026-03-25 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-25 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205
2026-03-25 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 928ce10f-74ef-57ff-b729-f4a26d193dc0 with identifier: 1981205 to the API
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '928ce10f-74ef-57ff-b729-f4a26d193dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 96704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 T-GDI HYBRID FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI HYBRID FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981205%27 HTTP/1.1" 200 None
2026-03-25 22:51:57 [ayvens.be] INFO: Saving data for 1981205: {'auction_closing_time': 1774855800.0, 'created_time': 1774392453.19435, 'last_price_update_time': 1774479117.716636}
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981205') HTTP/1.1" 204 0
2026-03-25 22:51:57 [ayvens.be] INFO: Found listing with ID: 1981206
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-25 22:51:57 [ayvens.be] INFO: Scrape type for 1981206: 2
2026-03-25 22:51:57 [ayvens.be] INFO: Extracting data for car ID: 1981206
2026-03-25 22:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-25 22:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 2
2026-03-25 22:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2681e870-05d3-5d78-8689-4aa49350be88 with scrape type 2
2026-03-25 22:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2681e870-05d3-5d78-8689-4aa49350be88, identifier: 1981206
2026-03-25 22:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-25 22:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206
2026-03-25 22:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2681e870-05d3-5d78-8689-4aa49350be88 with identifier: 1981206 to the API
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2681e870-05d3-5d78-8689-4aa49350be88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 45482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981206%27 HTTP/1.1" 200 None
2026-03-25 22:51:58 [ayvens.be] INFO: Saving data for 1981206: {'auction_closing_time': 1774855800.0, 'created_time': 1774392455.145681, 'last_price_update_time': 1774479118.125936}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981206') HTTP/1.1" 204 0
2026-03-25 22:51:58 [ayvens.be] INFO: Found listing with ID: 1981207
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-25 22:51:58 [ayvens.be] INFO: Scrape type for 1981207: 2
2026-03-25 22:51:58 [ayvens.be] INFO: Extracting data for car ID: 1981207
2026-03-25 22:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-25 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 2
2026-03-25 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with scrape type 2
2026-03-25 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4510b0a-1cbc-5e8a-8d83-d53fc2273850, identifier: 1981207
2026-03-25 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-25 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207
2026-03-25 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4510b0a-1cbc-5e8a-8d83-d53fc2273850 with identifier: 1981207 to the API
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': 'c4510b0a-1cbc-5e8a-8d83-d53fc2273850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 94084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981207%27 HTTP/1.1" 200 None
2026-03-25 22:51:58 [ayvens.be] INFO: Saving data for 1981207: {'auction_closing_time': 1774855800.0, 'created_time': 1774392457.061012, 'last_price_update_time': 1774479118.589316}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981207') HTTP/1.1" 204 0
2026-03-25 22:51:58 [ayvens.be] INFO: Found listing with ID: 1981208
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-25 22:51:58 [ayvens.be] INFO: Scrape type for 1981208: 2
2026-03-25 22:51:58 [ayvens.be] INFO: Extracting data for car ID: 1981208
2026-03-25 22:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-25 22:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 2
2026-03-25 22:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283ccbef-d068-51ad-a5a8-b2001efa15e6 with scrape type 2
2026-03-25 22:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 283ccbef-d068-51ad-a5a8-b2001efa15e6, identifier: 1981208
2026-03-25 22:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-25 22:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208
2026-03-25 22:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 283ccbef-d068-51ad-a5a8-b2001efa15e6 with identifier: 1981208 to the API
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '283ccbef-d068-51ad-a5a8-b2001efa15e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2-serie',
 'odometer': 150247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2-serie 2.0 218DA (100KW) GRAN COUPE',
 'transmission': 'automatic',
 'trim': '2.0 218DA (100KW) GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981208%27 HTTP/1.1" 200 None
2026-03-25 22:51:58 [ayvens.be] INFO: Saving data for 1981208: {'auction_closing_time': 1774855800.0, 'created_time': 1774392459.272674, 'last_price_update_time': 1774479118.972876}
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981208') HTTP/1.1" 204 0
2026-03-25 22:51:58 [ayvens.be] INFO: Found listing with ID: 1981209
2026-03-25 22:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-25 22:51:59 [ayvens.be] INFO: Scrape type for 1981209: 2
2026-03-25 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1981209
2026-03-25 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-25 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a007cff-3ab3-5401-9d18-ffd29573a611 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a007cff-3ab3-5401-9d18-ffd29573a611, identifier: 1981209
2026-03-25 22:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-25 22:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209
2026-03-25 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a007cff-3ab3-5401-9d18-ffd29573a611 with identifier: 1981209 to the API
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '8a007cff-3ab3-5401-9d18-ffd29573a611',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 119243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981209%27 HTTP/1.1" 200 None
2026-03-25 22:51:59 [ayvens.be] INFO: Saving data for 1981209: {'auction_closing_time': 1774855800.0, 'created_time': 1774392460.549924, 'last_price_update_time': 1774479119.370584}
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981209') HTTP/1.1" 204 0
2026-03-25 22:51:59 [ayvens.be] INFO: Found listing with ID: 1981210
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-25 22:51:59 [ayvens.be] INFO: Scrape type for 1981210: 2
2026-03-25 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1981210
2026-03-25 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-25 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6928d62f-759b-5f8e-a563-9425c1dcbdf1, identifier: 1981210
2026-03-25 22:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-25 22:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210
2026-03-25 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6928d62f-759b-5f8e-a563-9425c1dcbdf1 with identifier: 1981210 to the API
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'electric',
 'id': '6928d62f-759b-5f8e-a563-9425c1dcbdf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 104505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOL AMG',
 'vin': None,
 'year': 2022}
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981210%27 HTTP/1.1" 200 None
2026-03-25 22:51:59 [ayvens.be] INFO: Saving data for 1981210: {'auction_closing_time': 1774855800.0, 'created_time': 1774392462.23734, 'last_price_update_time': 1774479119.74115}
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981210') HTTP/1.1" 204 0
2026-03-25 22:51:59 [ayvens.be] INFO: Found listing with ID: 1981211
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-25 22:51:59 [ayvens.be] INFO: Scrape type for 1981211: 2
2026-03-25 22:51:59 [ayvens.be] INFO: Extracting data for car ID: 1981211
2026-03-25 22:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-25 22:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with scrape type 2
2026-03-25 22:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424, identifier: 1981211
2026-03-25 22:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-25 22:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211
2026-03-25 22:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9e7d8078-cf36-5dd2-bd67-3145a3dbb424 with identifier: 1981211 to the API
2026-03-25 22:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '9e7d8078-cf36-5dd2-bd67-3145a3dbb424',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 145571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 85KW DSG7 CLEVER',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981211%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Saving data for 1981211: {'auction_closing_time': 1774855800.0, 'created_time': 1774392464.538009, 'last_price_update_time': 1774479120.131736}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981211') HTTP/1.1" 204 0
2026-03-25 22:52:00 [ayvens.be] INFO: Found listing with ID: 1981212
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Scrape type for 1981212: 2
2026-03-25 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1981212
2026-03-25 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-25 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 2
2026-03-25 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4958349f-6e0c-51eb-a850-148d060247e2 with scrape type 2
2026-03-25 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4958349f-6e0c-51eb-a850-148d060247e2, identifier: 1981212
2026-03-25 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-25 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212
2026-03-25 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4958349f-6e0c-51eb-a850-148d060247e2 with identifier: 1981212 to the API
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '4958349f-6e0c-51eb-a850-148d060247e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 179602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981212%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Saving data for 1981212: {'auction_closing_time': 1774855800.0, 'created_time': 1774392465.853319, 'last_price_update_time': 1774479120.519569}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981212') HTTP/1.1" 204 0
2026-03-25 22:52:00 [ayvens.be] INFO: Found listing with ID: 1981213
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Scrape type for 1981213: 2
2026-03-25 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1981213
2026-03-25 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-25 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 2
2026-03-25 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with scrape type 2
2026-03-25 22:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56, identifier: 1981213
2026-03-25 22:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-25 22:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213
2026-03-25 22:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56 with identifier: 1981213 to the API
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dfb6b5ed-1ad9-5ae6-b2b7-0db2a5974b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 92742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981213%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Saving data for 1981213: {'auction_closing_time': 1774855800.0, 'created_time': 1774392467.524694, 'last_price_update_time': 1774479120.924949}
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981213') HTTP/1.1" 204 0
2026-03-25 22:52:00 [ayvens.be] INFO: Found listing with ID: 1981214
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-25 22:52:00 [ayvens.be] INFO: Scrape type for 1981214: 2
2026-03-25 22:52:00 [ayvens.be] INFO: Extracting data for car ID: 1981214
2026-03-25 22:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-25 22:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 2
2026-03-25 22:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccef6b72-81c5-575a-82e1-8e8a07591d49 with scrape type 2
2026-03-25 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ccef6b72-81c5-575a-82e1-8e8a07591d49, identifier: 1981214
2026-03-25 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-25 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214
2026-03-25 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ccef6b72-81c5-575a-82e1-8e8a07591d49 with identifier: 1981214 to the API
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ccef6b72-81c5-575a-82e1-8e8a07591d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 108361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981214%27 HTTP/1.1" 200 None
2026-03-25 22:52:01 [ayvens.be] INFO: Saving data for 1981214: {'auction_closing_time': 1774855800.0, 'created_time': 1774392470.370417, 'last_price_update_time': 1774479121.295171}
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981214') HTTP/1.1" 204 0
2026-03-25 22:52:01 [ayvens.be] INFO: Found listing with ID: 1981215
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-25 22:52:01 [ayvens.be] INFO: Scrape type for 1981215: 2
2026-03-25 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1981215
2026-03-25 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-25 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 2
2026-03-25 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc014a8-d2c4-5088-9e89-c21108672e4c with scrape type 2
2026-03-25 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fbc014a8-d2c4-5088-9e89-c21108672e4c, identifier: 1981215
2026-03-25 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-25 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215
2026-03-25 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fbc014a8-d2c4-5088-9e89-c21108672e4c with identifier: 1981215 to the API
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fbc014a8-d2c4-5088-9e89-c21108672e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 129280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 35 TDi Business Edition Advanced S '
          'tron.',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Advanced S tron.',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981215%27 HTTP/1.1" 200 None
2026-03-25 22:52:01 [ayvens.be] INFO: Saving data for 1981215: {'auction_closing_time': 1774855800.0, 'created_time': 1774392471.77565, 'last_price_update_time': 1774479121.679788}
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981215') HTTP/1.1" 204 0
2026-03-25 22:52:01 [ayvens.be] INFO: Found listing with ID: 1981216
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-25 22:52:01 [ayvens.be] INFO: Scrape type for 1981216: 2
2026-03-25 22:52:01 [ayvens.be] INFO: Extracting data for car ID: 1981216
2026-03-25 22:52:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-25 22:52:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 2
2026-03-25 22:52:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c718578a-7a51-5762-83df-cab4e808162f with scrape type 2
2026-03-25 22:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c718578a-7a51-5762-83df-cab4e808162f, identifier: 1981216
2026-03-25 22:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-25 22:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216
2026-03-25 22:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c718578a-7a51-5762-83df-cab4e808162f with identifier: 1981216 to the API
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c718578a-7a51-5762-83df-cab4e808162f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 110037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981216%27 HTTP/1.1" 200 None
2026-03-25 22:52:02 [ayvens.be] INFO: Saving data for 1981216: {'auction_closing_time': 1774855800.0, 'created_time': 1774392473.436078, 'last_price_update_time': 1774479122.073349}
2026-03-25 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981216') HTTP/1.1" 204 0
2026-03-25 22:52:02 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-25 22:52:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:52:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:52:04 [ayvens.be] INFO: Found listing with ID: 1981217
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-25 22:52:04 [ayvens.be] INFO: Scrape type for 1981217: 2
2026-03-25 22:52:04 [ayvens.be] INFO: Extracting data for car ID: 1981217
2026-03-25 22:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-25 22:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 2
2026-03-25 22:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 856191d6-dee9-53b1-8504-abc7615c1d43 with scrape type 2
2026-03-25 22:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 856191d6-dee9-53b1-8504-abc7615c1d43, identifier: 1981217
2026-03-25 22:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-25 22:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217
2026-03-25 22:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 856191d6-dee9-53b1-8504-abc7615c1d43 with identifier: 1981217 to the API
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '856191d6-dee9-53b1-8504-abc7615c1d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 79568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981217%27 HTTP/1.1" 200 None
2026-03-25 22:52:04 [ayvens.be] INFO: Saving data for 1981217: {'auction_closing_time': 1774855800.0, 'created_time': 1774392477.219672, 'last_price_update_time': 1774479124.910222}
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981217') HTTP/1.1" 204 0
2026-03-25 22:52:05 [ayvens.be] INFO: Found listing with ID: 1981218
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-25 22:52:05 [ayvens.be] INFO: Scrape type for 1981218: 2
2026-03-25 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1981218
2026-03-25 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-25 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5ecc8af-05b8-5f20-b299-a2ada04e59d3, identifier: 1981218
2026-03-25 22:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-25 22:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218
2026-03-25 22:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5ecc8af-05b8-5f20-b299-a2ada04e59d3 with identifier: 1981218 to the API
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b5ecc8af-05b8-5f20-b299-a2ada04e59d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 167242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Inscription',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Inscription',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981218%27 HTTP/1.1" 200 None
2026-03-25 22:52:05 [ayvens.be] INFO: Saving data for 1981218: {'auction_closing_time': 1774855800.0, 'created_time': 1774392476.430579, 'last_price_update_time': 1774479125.37269}
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981218') HTTP/1.1" 204 0
2026-03-25 22:52:05 [ayvens.be] INFO: Found listing with ID: 1981219
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-25 22:52:05 [ayvens.be] INFO: Scrape type for 1981219: 2
2026-03-25 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1981219
2026-03-25 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-25 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b, identifier: 1981219
2026-03-25 22:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-25 22:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219
2026-03-25 22:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b with identifier: 1981219 to the API
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '2fbc8b75-4f57-51c8-a86c-9d7fb2d17d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981219%27 HTTP/1.1" 200 None
2026-03-25 22:52:05 [ayvens.be] INFO: Saving data for 1981219: {'auction_closing_time': 1774855800.0, 'created_time': 1774392478.182956, 'last_price_update_time': 1774479125.778119}
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981219') HTTP/1.1" 204 0
2026-03-25 22:52:05 [ayvens.be] INFO: Found listing with ID: 1981220
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-25 22:52:05 [ayvens.be] INFO: Scrape type for 1981220: 2
2026-03-25 22:52:05 [ayvens.be] INFO: Extracting data for car ID: 1981220
2026-03-25 22:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-25 22:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with scrape type 2
2026-03-25 22:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453, identifier: 1981220
2026-03-25 22:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-25 22:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220
2026-03-25 22:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453 with identifier: 1981220 to the API
2026-03-25 22:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '1ee77feb-c3bf-5ec4-9a5f-80b82c7c7453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 63765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT 1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 120 S&S STANDARD PREMIUM',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981220%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Saving data for 1981220: {'auction_closing_time': 1774855800.0, 'created_time': 1774392480.091277, 'last_price_update_time': 1774479126.152281}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981220') HTTP/1.1" 204 0
2026-03-25 22:52:06 [ayvens.be] INFO: Found listing with ID: 1981221
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Scrape type for 1981221: 2
2026-03-25 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1981221
2026-03-25 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-25 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 2
2026-03-25 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d63efcb-7417-5059-ac68-bf58c9cb6092 with scrape type 2
2026-03-25 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d63efcb-7417-5059-ac68-bf58c9cb6092, identifier: 1981221
2026-03-25 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-25 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221
2026-03-25 22:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d63efcb-7417-5059-ac68-bf58c9cb6092 with identifier: 1981221 to the API
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '9d63efcb-7417-5059-ac68-bf58c9cb6092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 80974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981221%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Saving data for 1981221: {'auction_closing_time': 1774855800.0, 'created_time': 1774392481.056499, 'last_price_update_time': 1774479126.563348}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981221') HTTP/1.1" 204 0
2026-03-25 22:52:06 [ayvens.be] INFO: Found listing with ID: 1981222
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Scrape type for 1981222: 2
2026-03-25 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1981222
2026-03-25 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-25 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 2
2026-03-25 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with scrape type 2
2026-03-25 22:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064, identifier: 1981222
2026-03-25 22:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-25 22:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222
2026-03-25 22:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c8afef5-b3db-5cb5-89c6-a53c9ea23064 with identifier: 1981222 to the API
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c8afef5-b3db-5cb5-89c6-a53c9ea23064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 73652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981222%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Saving data for 1981222: {'auction_closing_time': 1774855800.0, 'created_time': 1774392483.082696, 'last_price_update_time': 1774479126.950408}
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981222') HTTP/1.1" 204 0
2026-03-25 22:52:06 [ayvens.be] INFO: Found listing with ID: 1981223
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-25 22:52:06 [ayvens.be] INFO: Scrape type for 1981223: 2
2026-03-25 22:52:06 [ayvens.be] INFO: Extracting data for car ID: 1981223
2026-03-25 22:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-25 22:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 2
2026-03-25 22:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d40f18b1-eb43-5300-84a5-8ae362c6f8eb with scrape type 2
2026-03-25 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d40f18b1-eb43-5300-84a5-8ae362c6f8eb, identifier: 1981223
2026-03-25 22:52:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -2 pages/min), scraped 306 items (at 114 items/min)
2026-03-25 22:52:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-25 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223
2026-03-25 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d40f18b1-eb43-5300-84a5-8ae362c6f8eb with identifier: 1981223 to the API
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd40f18b1-eb43-5300-84a5-8ae362c6f8eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 121909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981223%27 HTTP/1.1" 200 None
2026-03-25 22:52:07 [ayvens.be] INFO: Saving data for 1981223: {'auction_closing_time': 1774855800.0, 'created_time': 1774392484.637299, 'last_price_update_time': 1774479127.328448}
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981223') HTTP/1.1" 204 0
2026-03-25 22:52:07 [ayvens.be] INFO: Found listing with ID: 1981224
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-25 22:52:07 [ayvens.be] INFO: Scrape type for 1981224: 2
2026-03-25 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1981224
2026-03-25 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-25 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 2
2026-03-25 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91167241-1ce0-532b-91ad-1de2768d8ed7 with scrape type 2
2026-03-25 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91167241-1ce0-532b-91ad-1de2768d8ed7, identifier: 1981224
2026-03-25 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-25 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224
2026-03-25 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91167241-1ce0-532b-91ad-1de2768d8ed7 with identifier: 1981224 to the API
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '91167241-1ce0-532b-91ad-1de2768d8ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 97086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI 81KW AMBITION',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW AMBITION',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981224%27 HTTP/1.1" 200 None
2026-03-25 22:52:07 [ayvens.be] INFO: Saving data for 1981224: {'auction_closing_time': 1774855800.0, 'created_time': 1774392487.685204, 'last_price_update_time': 1774479127.699884}
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981224') HTTP/1.1" 204 0
2026-03-25 22:52:07 [ayvens.be] INFO: Found listing with ID: 1981225
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-25 22:52:07 [ayvens.be] INFO: Scrape type for 1981225: 2
2026-03-25 22:52:07 [ayvens.be] INFO: Extracting data for car ID: 1981225
2026-03-25 22:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-25 22:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 2
2026-03-25 22:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with scrape type 2
2026-03-25 22:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 107c88f6-ede3-5766-9ff9-509e0ef77cd0, identifier: 1981225
2026-03-25 22:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-25 22:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225
2026-03-25 22:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 107c88f6-ede3-5766-9ff9-509e0ef77cd0 with identifier: 1981225 to the API
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'petrol',
 'id': '107c88f6-ede3-5766-9ff9-509e0ef77cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 XDRIVE20I AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE20I AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981225%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Saving data for 1981225: {'auction_closing_time': 1774855800.0, 'created_time': 1774392491.442542, 'last_price_update_time': 1774479128.09237}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981225') HTTP/1.1" 204 0
2026-03-25 22:52:08 [ayvens.be] INFO: Found listing with ID: 1981226
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Scrape type for 1981226: 2
2026-03-25 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1981226
2026-03-25 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-25 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 2
2026-03-25 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490c4e0d-78be-583b-a19e-db898b47043b with scrape type 2
2026-03-25 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 490c4e0d-78be-583b-a19e-db898b47043b, identifier: 1981226
2026-03-25 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-25 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226
2026-03-25 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 490c4e0d-78be-583b-a19e-db898b47043b with identifier: 1981226 to the API
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:30:00Z',
 'fuel_type': 'diesel',
 'id': '490c4e0d-78be-583b-a19e-db898b47043b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40983',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Passat',
 'odometer': 218512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Passat 1.6 CR TDi Comfortline Business DSG STOCK',
 'transmission': 'automatic',
 'trim': '1.6 CR TDi Comfortline Business DSG STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271981226%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Saving data for 1981226: {'auction_closing_time': 1774855800.0, 'created_time': 1774392492.46014, 'last_price_update_time': 1774479128.492812}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1981226') HTTP/1.1" 204 0
2026-03-25 22:52:08 [ayvens.be] INFO: Found listing with ID: 1978467
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Scrape type for 1978467: 2
2026-03-25 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1978467
2026-03-25 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-25 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-25 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with scrape type 2
2026-03-25 22:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab, identifier: 1978467
2026-03-25 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-25 22:52:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467
2026-03-25 22:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d0e3722-8fdf-5a4b-bc93-12c345f69aab with identifier: 1978467 to the API
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'MOONDUST SILVER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '2d0e3722-8fdf-5a4b-bc93-12c345f69aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS - 2018',
 'odometer': 91431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS - 2018 1.0 EcoBoost ST-Line Business Winter',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line Business Winter',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978467%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Saving data for 1978467: {'auction_closing_time': 1774854000.0, 'created_time': 1774305925.581173, 'last_price_update_time': 1774479128.90649}
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978467') HTTP/1.1" 204 0
2026-03-25 22:52:08 [ayvens.be] INFO: Found listing with ID: 1978468
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-25 22:52:08 [ayvens.be] INFO: Scrape type for 1978468: 2
2026-03-25 22:52:08 [ayvens.be] INFO: Extracting data for car ID: 1978468
2026-03-25 22:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-25 22:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-25 22:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with scrape type 2
2026-03-25 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c, identifier: 1978468
2026-03-25 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-25 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468
2026-03-25 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcbbd5ce-3466-53ba-b6a6-629a539f7f4c with identifier: 1978468 to the API
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLEU BOUTASQUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fcbbd5ce-3466-53ba-b6a6-629a539f7f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 - 2017',
 'odometer': 112390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 - 2017 1.2 PureTech Allure (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.2 PureTech Allure (EU6.2)',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978468%27 HTTP/1.1" 200 None
2026-03-25 22:52:09 [ayvens.be] INFO: Saving data for 1978468: {'auction_closing_time': 1774854000.0, 'created_time': 1774305929.210301, 'last_price_update_time': 1774479129.285386}
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978468') HTTP/1.1" 204 0
2026-03-25 22:52:09 [ayvens.be] INFO: Found listing with ID: 1978469
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-25 22:52:09 [ayvens.be] INFO: Scrape type for 1978469: 2
2026-03-25 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1978469
2026-03-25 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-25 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-25 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79cc47e-5142-5c31-ba8a-5fe779924ecb with scrape type 2
2026-03-25 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f79cc47e-5142-5c31-ba8a-5fe779924ecb, identifier: 1978469
2026-03-25 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-25 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469
2026-03-25 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f79cc47e-5142-5c31-ba8a-5fe779924ecb with identifier: 1978469 to the API
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f79cc47e-5142-5c31-ba8a-5fe779924ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SEDAN DIESEL - 2020',
 'odometer': 57850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SEDAN DIESEL - 2020 35 TDi S line S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi S line S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978469%27 HTTP/1.1" 200 None
2026-03-25 22:52:09 [ayvens.be] INFO: Saving data for 1978469: {'auction_closing_time': 1774854000.0, 'created_time': 1774305928.180435, 'last_price_update_time': 1774479129.741391}
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978469') HTTP/1.1" 204 0
2026-03-25 22:52:09 [ayvens.be] INFO: Found listing with ID: 1978470
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-25 22:52:09 [ayvens.be] INFO: Scrape type for 1978470: 2
2026-03-25 22:52:09 [ayvens.be] INFO: Extracting data for car ID: 1978470
2026-03-25 22:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-25 22:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-25 22:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with scrape type 2
2026-03-25 22:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301, identifier: 1978470
2026-03-25 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-25 22:52:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470
2026-03-25 22:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30fcdcad-20a5-54b7-a6bd-ebd58bdc4301 with identifier: 1978470 to the API
2026-03-25 22:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30fcdcad-20a5-54b7-a6bd-ebd58bdc4301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO 35 FOURGON LWB DSL - 20',
 'odometer': 116151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seats_number': None,
 'seller_name': None,
 'title': 'FIAT DUCATO 35 FOURGON LWB DSL - 20 2.0 Mjet L3H2 (EU6)',
 'transmission': 'manual',
 'trim': '2.0 Mjet L3H2 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978470%27 HTTP/1.1" 200 None
2026-03-25 22:52:10 [ayvens.be] INFO: Saving data for 1978470: {'auction_closing_time': 1774854000.0, 'created_time': 1774305930.007406, 'last_price_update_time': 1774479130.11425}
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978470') HTTP/1.1" 204 0
2026-03-25 22:52:10 [ayvens.be] INFO: Found listing with ID: 1978471
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-25 22:52:10 [ayvens.be] INFO: Scrape type for 1978471: 2
2026-03-25 22:52:10 [ayvens.be] INFO: Extracting data for car ID: 1978471
2026-03-25 22:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-25 22:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-25 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb8849a-6dd2-5d69-9764-d04ef9128f8f with scrape type 2
2026-03-25 22:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbb8849a-6dd2-5d69-9764-d04ef9128f8f, identifier: 1978471
2026-03-25 22:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-25 22:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471
2026-03-25 22:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbb8849a-6dd2-5d69-9764-d04ef9128f8f with identifier: 1978471 to the API
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbb8849a-6dd2-5d69-9764-d04ef9128f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT - 2020',
 'odometer': 70409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT - 2020 35 TFSI S tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI S tronic',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978471%27 HTTP/1.1" 200 None
2026-03-25 22:52:10 [ayvens.be] INFO: Saving data for 1978471: {'auction_closing_time': 1774854000.0, 'created_time': 1774305931.892437, 'last_price_update_time': 1774479130.489636}
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978471') HTTP/1.1" 204 0
2026-03-25 22:52:10 [ayvens.be] INFO: Found listing with ID: 1978472
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-25 22:52:10 [ayvens.be] INFO: Scrape type for 1978472: 2
2026-03-25 22:52:10 [ayvens.be] INFO: Extracting data for car ID: 1978472
2026-03-25 22:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-25 22:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-25 22:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809bf565-ad99-5a94-b968-77e20618ac73 with scrape type 2
2026-03-25 22:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 809bf565-ad99-5a94-b968-77e20618ac73, identifier: 1978472
2026-03-25 22:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-25 22:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472
2026-03-25 22:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 809bf565-ad99-5a94-b968-77e20618ac73 with identifier: 1978472 to the API
2026-03-25 22:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '809bf565-ad99-5a94-b968-77e20618ac73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 47854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'transmission': 'automatic',
 'trim': '1.6 CRDI 136 MHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978472%27 HTTP/1.1" 200 None
2026-03-25 22:52:11 [ayvens.be] INFO: Saving data for 1978472: {'auction_closing_time': 1774854000.0, 'created_time': 1774305933.047169, 'last_price_update_time': 1774479131.473786}
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978472') HTTP/1.1" 204 0
2026-03-25 22:52:11 [ayvens.be] INFO: Found listing with ID: 1978473
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-25 22:52:11 [ayvens.be] INFO: Scrape type for 1978473: 2
2026-03-25 22:52:11 [ayvens.be] INFO: Extracting data for car ID: 1978473
2026-03-25 22:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-25 22:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-25 22:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with scrape type 2
2026-03-25 22:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5, identifier: 1978473
2026-03-25 22:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-25 22:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473
2026-03-25 22:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5 with identifier: 1978473 to the API
2026-03-25 22:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aa21bee0-3dc1-5a55-90e0-bcd5cce74cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 65370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978473%27 HTTP/1.1" 200 None
2026-03-25 22:52:12 [ayvens.be] INFO: Saving data for 1978473: {'auction_closing_time': 1774854000.0, 'created_time': 1774305934.763122, 'last_price_update_time': 1774479132.484467}
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978473') HTTP/1.1" 204 0
2026-03-25 22:52:12 [ayvens.be] INFO: Found listing with ID: 1978474
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-25 22:52:12 [ayvens.be] INFO: Scrape type for 1978474: 2
2026-03-25 22:52:12 [ayvens.be] INFO: Extracting data for car ID: 1978474
2026-03-25 22:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-25 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-25 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 896ef9b3-abd7-55d8-baba-f01b99006ee0 with scrape type 2
2026-03-25 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 896ef9b3-abd7-55d8-baba-f01b99006ee0, identifier: 1978474
2026-03-25 22:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-25 22:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474
2026-03-25 22:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 896ef9b3-abd7-55d8-baba-f01b99006ee0 with identifier: 1978474 to the API
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '896ef9b3-abd7-55d8-baba-f01b99006ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 210743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978474%27 HTTP/1.1" 200 None
2026-03-25 22:52:12 [ayvens.be] INFO: Saving data for 1978474: {'auction_closing_time': 1774854000.0, 'created_time': 1774305936.608962, 'last_price_update_time': 1774479132.845564}
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978474') HTTP/1.1" 204 0
2026-03-25 22:52:12 [ayvens.be] INFO: Found listing with ID: 1978475
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-25 22:52:12 [ayvens.be] INFO: Scrape type for 1978475: 2
2026-03-25 22:52:12 [ayvens.be] INFO: Extracting data for car ID: 1978475
2026-03-25 22:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-25 22:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-25 22:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606ca47f-f13e-5794-8919-5c666f0653e3 with scrape type 2
2026-03-25 22:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 606ca47f-f13e-5794-8919-5c666f0653e3, identifier: 1978475
2026-03-25 22:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-25 22:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475
2026-03-25 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 606ca47f-f13e-5794-8919-5c666f0653e3 with identifier: 1978475 to the API
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '606ca47f-f13e-5794-8919-5c666f0653e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C4',
 'odometer': 148256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C4 1.5 BLUEHDI 130 S&S SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978475%27 HTTP/1.1" 200 None
2026-03-25 22:52:13 [ayvens.be] INFO: Saving data for 1978475: {'auction_closing_time': 1774854000.0, 'created_time': 1774305938.424594, 'last_price_update_time': 1774479133.225477}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978475') HTTP/1.1" 204 0
2026-03-25 22:52:13 [ayvens.be] INFO: Found listing with ID: 1978476
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-25 22:52:13 [ayvens.be] INFO: Scrape type for 1978476: 2
2026-03-25 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1978476
2026-03-25 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-25 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-25 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8303c6eb-cc26-557c-b7c8-1758d5f61559 with scrape type 2
2026-03-25 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8303c6eb-cc26-557c-b7c8-1758d5f61559, identifier: 1978476
2026-03-25 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-25 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476
2026-03-25 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8303c6eb-cc26-557c-b7c8-1758d5f61559 with identifier: 1978476 to the API
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '8303c6eb-cc26-557c-b7c8-1758d5f61559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 252773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978476%27 HTTP/1.1" 200 None
2026-03-25 22:52:13 [ayvens.be] INFO: Saving data for 1978476: {'auction_closing_time': 1774854000.0, 'created_time': 1774305940.149589, 'last_price_update_time': 1774479133.589978}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978476') HTTP/1.1" 204 0
2026-03-25 22:52:13 [ayvens.be] INFO: Found listing with ID: 1978477
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-25 22:52:13 [ayvens.be] INFO: Scrape type for 1978477: 2
2026-03-25 22:52:13 [ayvens.be] INFO: Extracting data for car ID: 1978477
2026-03-25 22:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-25 22:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-25 22:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10caeb8-09ba-5c58-a982-0d21ea9ebaea with scrape type 2
2026-03-25 22:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f10caeb8-09ba-5c58-a982-0d21ea9ebaea, identifier: 1978477
2026-03-25 22:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-25 22:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477
2026-03-25 22:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f10caeb8-09ba-5c58-a982-0d21ea9ebaea with identifier: 1978477 to the API
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f10caeb8-09ba-5c58-a982-0d21ea9ebaea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 40529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978477%27 HTTP/1.1" 200 None
2026-03-25 22:52:13 [ayvens.be] INFO: Saving data for 1978477: {'auction_closing_time': 1774854000.0, 'created_time': 1774305941.620308, 'last_price_update_time': 1774479133.982846}
2026-03-25 22:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978477') HTTP/1.1" 204 0
2026-03-25 22:52:14 [ayvens.be] INFO: Found listing with ID: 1978478
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-25 22:52:14 [ayvens.be] INFO: Scrape type for 1978478: 2
2026-03-25 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1978478
2026-03-25 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-25 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a9dda7-405b-5886-9d69-96d02d20f488 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0a9dda7-405b-5886-9d69-96d02d20f488, identifier: 1978478
2026-03-25 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-25 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478
2026-03-25 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0a9dda7-405b-5886-9d69-96d02d20f488 with identifier: 1978478 to the API
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0a9dda7-405b-5886-9d69-96d02d20f488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 87601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 TDI 35 S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978478%27 HTTP/1.1" 200 None
2026-03-25 22:52:14 [ayvens.be] INFO: Saving data for 1978478: {'auction_closing_time': 1774854000.0, 'created_time': 1774305943.707778, 'last_price_update_time': 1774479134.367926}
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978478') HTTP/1.1" 204 0
2026-03-25 22:52:14 [ayvens.be] INFO: Found listing with ID: 1978479
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-25 22:52:14 [ayvens.be] INFO: Scrape type for 1978479: 2
2026-03-25 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1978479
2026-03-25 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-25 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb7fe50-46a0-518d-a563-078b2e772404 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cfb7fe50-46a0-518d-a563-078b2e772404, identifier: 1978479
2026-03-25 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-25 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479
2026-03-25 22:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cfb7fe50-46a0-518d-a563-078b2e772404 with identifier: 1978479 to the API
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cfb7fe50-46a0-518d-a563-078b2e772404',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 121907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978479%27 HTTP/1.1" 200 None
2026-03-25 22:52:14 [ayvens.be] INFO: Saving data for 1978479: {'auction_closing_time': 1774854000.0, 'created_time': 1774305945.941173, 'last_price_update_time': 1774479134.748868}
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978479') HTTP/1.1" 204 0
2026-03-25 22:52:14 [ayvens.be] INFO: Found listing with ID: 1978480
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-25 22:52:14 [ayvens.be] INFO: Scrape type for 1978480: 2
2026-03-25 22:52:14 [ayvens.be] INFO: Extracting data for car ID: 1978480
2026-03-25 22:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-25 22:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f5599f-eec1-560c-89df-9f0e076c42f2 with scrape type 2
2026-03-25 22:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43f5599f-eec1-560c-89df-9f0e076c42f2, identifier: 1978480
2026-03-25 22:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-25 22:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480
2026-03-25 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43f5599f-eec1-560c-89df-9f0e076c42f2 with identifier: 1978480 to the API
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '43f5599f-eec1-560c-89df-9f0e076c42f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 61067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978480%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Saving data for 1978480: {'auction_closing_time': 1774854000.0, 'created_time': 1774305948.115122, 'last_price_update_time': 1774479135.195804}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978480') HTTP/1.1" 204 0
2026-03-25 22:52:15 [ayvens.be] INFO: Found listing with ID: 1978481
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Scrape type for 1978481: 2
2026-03-25 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1978481
2026-03-25 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-25 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-25 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with scrape type 2
2026-03-25 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928, identifier: 1978481
2026-03-25 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-25 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481
2026-03-25 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c3b6e2-0c48-590c-ba3d-0250e1b9d928 with identifier: 1978481 to the API
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c3b6e2-0c48-590c-ba3d-0250e1b9d928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 211793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978481%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Saving data for 1978481: {'auction_closing_time': 1774854000.0, 'created_time': 1774305949.317347, 'last_price_update_time': 1774479135.571247}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978481') HTTP/1.1" 204 0
2026-03-25 22:52:15 [ayvens.be] INFO: Found listing with ID: 1978482
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Scrape type for 1978482: 2
2026-03-25 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1978482
2026-03-25 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-25 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-25 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6be95bf-6e0a-5d91-b5bd-437f53dde13f with scrape type 2
2026-03-25 22:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6be95bf-6e0a-5d91-b5bd-437f53dde13f, identifier: 1978482
2026-03-25 22:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-25 22:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482
2026-03-25 22:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6be95bf-6e0a-5d91-b5bd-437f53dde13f with identifier: 1978482 to the API
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e6be95bf-6e0a-5d91-b5bd-437f53dde13f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 166861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978482%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Saving data for 1978482: {'auction_closing_time': 1774854000.0, 'created_time': 1774305952.067454, 'last_price_update_time': 1774479135.944732}
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978482') HTTP/1.1" 204 0
2026-03-25 22:52:15 [ayvens.be] INFO: Found listing with ID: 1978483
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-25 22:52:15 [ayvens.be] INFO: Scrape type for 1978483: 2
2026-03-25 22:52:15 [ayvens.be] INFO: Extracting data for car ID: 1978483
2026-03-25 22:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-25 22:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-25 22:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51d90862-96e7-5f12-9a7a-52f62015120b with scrape type 2
2026-03-25 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51d90862-96e7-5f12-9a7a-52f62015120b, identifier: 1978483
2026-03-25 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-25 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483
2026-03-25 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51d90862-96e7-5f12-9a7a-52f62015120b with identifier: 1978483 to the API
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '51d90862-96e7-5f12-9a7a-52f62015120b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 173398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978483%27 HTTP/1.1" 200 None
2026-03-25 22:52:16 [ayvens.be] INFO: Saving data for 1978483: {'auction_closing_time': 1774854000.0, 'created_time': 1774305953.430147, 'last_price_update_time': 1774479136.321725}
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978483') HTTP/1.1" 204 0
2026-03-25 22:52:16 [ayvens.be] INFO: Found listing with ID: 1978484
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-25 22:52:16 [ayvens.be] INFO: Scrape type for 1978484: 2
2026-03-25 22:52:16 [ayvens.be] INFO: Extracting data for car ID: 1978484
2026-03-25 22:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-25 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-25 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21561285-2e69-59fd-90f0-2bc2813b1502 with scrape type 2
2026-03-25 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21561285-2e69-59fd-90f0-2bc2813b1502, identifier: 1978484
2026-03-25 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-25 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484
2026-03-25 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21561285-2e69-59fd-90f0-2bc2813b1502 with identifier: 1978484 to the API
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '21561285-2e69-59fd-90f0-2bc2813b1502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 158748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978484%27 HTTP/1.1" 200 None
2026-03-25 22:52:16 [ayvens.be] INFO: Saving data for 1978484: {'auction_closing_time': 1774854000.0, 'created_time': 1774305955.090734, 'last_price_update_time': 1774479136.711566}
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978484') HTTP/1.1" 204 0
2026-03-25 22:52:16 [ayvens.be] INFO: Found listing with ID: 1978485
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-25 22:52:16 [ayvens.be] INFO: Scrape type for 1978485: 2
2026-03-25 22:52:16 [ayvens.be] INFO: Extracting data for car ID: 1978485
2026-03-25 22:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-25 22:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-25 22:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b98d3af-5ca9-5501-8411-b1ccc14a16db with scrape type 2
2026-03-25 22:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b98d3af-5ca9-5501-8411-b1ccc14a16db, identifier: 1978485
2026-03-25 22:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-25 22:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485
2026-03-25 22:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b98d3af-5ca9-5501-8411-b1ccc14a16db with identifier: 1978485 to the API
2026-03-25 22:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2b98d3af-5ca9-5501-8411-b1ccc14a16db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 65651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978485%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Saving data for 1978485: {'auction_closing_time': 1774854000.0, 'created_time': 1774306012.091532, 'last_price_update_time': 1774479137.11004}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978485') HTTP/1.1" 204 0
2026-03-25 22:52:17 [ayvens.be] INFO: Found listing with ID: 1978486
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Scrape type for 1978486: 2
2026-03-25 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1978486
2026-03-25 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-25 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-25 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with scrape type 2
2026-03-25 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c, identifier: 1978486
2026-03-25 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-25 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486
2026-03-25 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80e3f8c3-b697-5f49-bf6f-69f4cccef89c with identifier: 1978486 to the API
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '80e3f8c3-b697-5f49-bf6f-69f4cccef89c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 45712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978486%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Saving data for 1978486: {'auction_closing_time': 1774854000.0, 'created_time': 1774306009.399741, 'last_price_update_time': 1774479137.500406}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978486') HTTP/1.1" 204 0
2026-03-25 22:52:17 [ayvens.be] INFO: Found listing with ID: 1978487
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Scrape type for 1978487: 2
2026-03-25 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1978487
2026-03-25 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-25 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-25 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with scrape type 2
2026-03-25 22:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33674112-cc7a-512a-a6d5-c1ed38fe95c9, identifier: 1978487
2026-03-25 22:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-25 22:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487
2026-03-25 22:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33674112-cc7a-512a-a6d5-c1ed38fe95c9 with identifier: 1978487 to the API
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33674112-cc7a-512a-a6d5-c1ed38fe95c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GRAND TOURNEO CONNECT',
 'odometer': 181137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD GRAND TOURNEO CONNECT 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978487%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Saving data for 1978487: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.505855, 'last_price_update_time': 1774479137.886506}
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978487') HTTP/1.1" 204 0
2026-03-25 22:52:17 [ayvens.be] INFO: Found listing with ID: 1978488
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-25 22:52:17 [ayvens.be] INFO: Scrape type for 1978488: 2
2026-03-25 22:52:17 [ayvens.be] INFO: Extracting data for car ID: 1978488
2026-03-25 22:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-25 22:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-25 22:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 566d6efa-4328-52e0-adc7-a57383e86ce1 with scrape type 2
2026-03-25 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 566d6efa-4328-52e0-adc7-a57383e86ce1, identifier: 1978488
2026-03-25 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-25 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488
2026-03-25 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 566d6efa-4328-52e0-adc7-a57383e86ce1 with identifier: 1978488 to the API
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '566d6efa-4328-52e0-adc7-a57383e86ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 92937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978488%27 HTTP/1.1" 200 None
2026-03-25 22:52:18 [ayvens.be] INFO: Saving data for 1978488: {'auction_closing_time': 1774854000.0, 'created_time': 1774306008.670182, 'last_price_update_time': 1774479138.309245}
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978488') HTTP/1.1" 204 0
2026-03-25 22:52:18 [ayvens.be] INFO: Found listing with ID: 1978489
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-25 22:52:18 [ayvens.be] INFO: Scrape type for 1978489: 2
2026-03-25 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1978489
2026-03-25 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-25 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-25 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222e6fe1-a081-58dd-a757-065567ce6ac2 with scrape type 2
2026-03-25 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 222e6fe1-a081-58dd-a757-065567ce6ac2, identifier: 1978489
2026-03-25 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-25 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489
2026-03-25 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 222e6fe1-a081-58dd-a757-065567ce6ac2 with identifier: 1978489 to the API
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '222e6fe1-a081-58dd-a757-065567ce6ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'ASTRA SPORTS TOURER DIESEL - 2',
 'odometer': 141412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL ASTRA SPORTS TOURER DIESEL - 2 1.5 Turbo D Edition S-S',
 'transmission': 'manual',
 'trim': '1.5 Turbo D Edition S-S',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978489%27 HTTP/1.1" 200 None
2026-03-25 22:52:18 [ayvens.be] INFO: Saving data for 1978489: {'auction_closing_time': 1774854000.0, 'created_time': 1774306002.407456, 'last_price_update_time': 1774479138.678419}
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978489') HTTP/1.1" 204 0
2026-03-25 22:52:18 [ayvens.be] INFO: Found listing with ID: 1978490
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-25 22:52:18 [ayvens.be] INFO: Scrape type for 1978490: 2
2026-03-25 22:52:18 [ayvens.be] INFO: Extracting data for car ID: 1978490
2026-03-25 22:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-25 22:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-25 22:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with scrape type 2
2026-03-25 22:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6, identifier: 1978490
2026-03-25 22:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-25 22:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490
2026-03-25 22:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6 with identifier: 1978490 to the API
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dbbf4d8f-b0d6-5bc9-9293-153e375f0ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA SPORTS TOURER',
 'odometer': 87815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA SPORTS TOURER 1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 90KW S-S BUSINESS ELEGANCE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978490%27 HTTP/1.1" 200 None
2026-03-25 22:52:19 [ayvens.be] INFO: Saving data for 1978490: {'auction_closing_time': 1774854000.0, 'created_time': 1774306001.139824, 'last_price_update_time': 1774479139.079925}
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978490') HTTP/1.1" 204 0
2026-03-25 22:52:19 [ayvens.be] INFO: Found listing with ID: 1978491
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-25 22:52:19 [ayvens.be] INFO: Scrape type for 1978491: 2
2026-03-25 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1978491
2026-03-25 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-25 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-25 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 785f66e5-e9cb-545f-9a3e-df3ed0688872 with scrape type 2
2026-03-25 22:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 785f66e5-e9cb-545f-9a3e-df3ed0688872, identifier: 1978491
2026-03-25 22:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-25 22:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491
2026-03-25 22:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 785f66e5-e9cb-545f-9a3e-df3ed0688872 with identifier: 1978491 to the API
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '785f66e5-e9cb-545f-9a3e-df3ed0688872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 40369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978491%27 HTTP/1.1" 200 None
2026-03-25 22:52:19 [ayvens.be] INFO: Saving data for 1978491: {'auction_closing_time': 1774854000.0, 'created_time': 1774305998.944648, 'last_price_update_time': 1774479139.573436}
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978491') HTTP/1.1" 204 0
2026-03-25 22:52:19 [ayvens.be] INFO: Found listing with ID: 1978492
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-25 22:52:19 [ayvens.be] INFO: Scrape type for 1978492: 2
2026-03-25 22:52:19 [ayvens.be] INFO: Extracting data for car ID: 1978492
2026-03-25 22:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-25 22:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-25 22:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with scrape type 2
2026-03-25 22:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1, identifier: 1978492
2026-03-25 22:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-25 22:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492
2026-03-25 22:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36c1d133-eb00-5228-a9ff-4bc35b8ef9d1 with identifier: 1978492 to the API
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36c1d133-eb00-5228-a9ff-4bc35b8ef9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 112992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978492%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Saving data for 1978492: {'auction_closing_time': 1774854000.0, 'created_time': 1774305964.996659, 'last_price_update_time': 1774479140.051078}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978492') HTTP/1.1" 204 0
2026-03-25 22:52:20 [ayvens.be] INFO: Found listing with ID: 1978493
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Scrape type for 1978493: 2
2026-03-25 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1978493
2026-03-25 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-25 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55067381-fc8f-534d-b377-5c6ce1942d59 with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55067381-fc8f-534d-b377-5c6ce1942d59, identifier: 1978493
2026-03-25 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-25 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493
2026-03-25 22:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55067381-fc8f-534d-b377-5c6ce1942d59 with identifier: 1978493 to the API
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '55067381-fc8f-534d-b377-5c6ce1942d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 136511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 318 dA AdBlue',
 'transmission': 'automatic',
 'trim': '318 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978493%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Saving data for 1978493: {'auction_closing_time': 1774854000.0, 'created_time': 1774305997.51264, 'last_price_update_time': 1774479140.443427}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978493') HTTP/1.1" 204 0
2026-03-25 22:52:20 [ayvens.be] INFO: Found listing with ID: 1978494
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Scrape type for 1978494: 2
2026-03-25 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1978494
2026-03-25 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-25 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33fd3e14-efe3-5867-9ca3-466efb909f0f with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33fd3e14-efe3-5867-9ca3-466efb909f0f, identifier: 1978494
2026-03-25 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-25 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494
2026-03-25 22:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33fd3e14-efe3-5867-9ca3-466efb909f0f with identifier: 1978494 to the API
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '33fd3e14-efe3-5867-9ca3-466efb909f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON DIESEL',
 'odometer': 132078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON DIESEL 2.0 TDi SCR R-Line (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR R-Line (EU6.2) STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978494%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Saving data for 1978494: {'auction_closing_time': 1774854000.0, 'created_time': 1774305967.956642, 'last_price_update_time': 1774479140.828423}
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978494') HTTP/1.1" 204 0
2026-03-25 22:52:20 [ayvens.be] INFO: Found listing with ID: 1978495
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-25 22:52:20 [ayvens.be] INFO: Scrape type for 1978495: 2
2026-03-25 22:52:20 [ayvens.be] INFO: Extracting data for car ID: 1978495
2026-03-25 22:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-25 22:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with scrape type 2
2026-03-25 22:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f, identifier: 1978495
2026-03-25 22:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-25 22:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495
2026-03-25 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f with identifier: 1978495 to the API
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a5c48fa-a2b8-5cd7-9e4a-ff3b7ab5310f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 152046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S GT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978495%27 HTTP/1.1" 200 None
2026-03-25 22:52:21 [ayvens.be] INFO: Saving data for 1978495: {'auction_closing_time': 1774854000.0, 'created_time': 1774305996.455177, 'last_price_update_time': 1774479141.263541}
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978495') HTTP/1.1" 204 0
2026-03-25 22:52:21 [ayvens.be] INFO: Found listing with ID: 1978496
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-25 22:52:21 [ayvens.be] INFO: Scrape type for 1978496: 2
2026-03-25 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1978496
2026-03-25 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-25 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-25 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2b3d3-d960-5423-8807-a83eafa5bf3b with scrape type 2
2026-03-25 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9be2b3d3-d960-5423-8807-a83eafa5bf3b, identifier: 1978496
2026-03-25 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-25 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496
2026-03-25 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9be2b3d3-d960-5423-8807-a83eafa5bf3b with identifier: 1978496 to the API
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '9be2b3d3-d960-5423-8807-a83eafa5bf3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 161718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI S TRONIC',
 'transmission': 'automatic',
 'trim': '1.5 35 TFSI S TRONIC',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978496%27 HTTP/1.1" 200 None
2026-03-25 22:52:21 [ayvens.be] INFO: Saving data for 1978496: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.517572, 'last_price_update_time': 1774479141.7081}
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978496') HTTP/1.1" 204 0
2026-03-25 22:52:21 [ayvens.be] INFO: Found listing with ID: 1978497
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-25 22:52:21 [ayvens.be] INFO: Scrape type for 1978497: 2
2026-03-25 22:52:21 [ayvens.be] INFO: Extracting data for car ID: 1978497
2026-03-25 22:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-25 22:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-25 22:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f29ab27-6670-5485-8d26-306227526cd3 with scrape type 2
2026-03-25 22:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8f29ab27-6670-5485-8d26-306227526cd3, identifier: 1978497
2026-03-25 22:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-25 22:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497
2026-03-25 22:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8f29ab27-6670-5485-8d26-306227526cd3 with identifier: 1978497 to the API
2026-03-25 22:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '8f29ab27-6670-5485-8d26-306227526cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 162602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.5 ETSI 96KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '1.5 ETSI 96KW DSG LIFE',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978497%27 HTTP/1.1" 200 None
2026-03-25 22:52:22 [ayvens.be] INFO: Saving data for 1978497: {'auction_closing_time': 1774854000.0, 'created_time': 1774305989.041022, 'last_price_update_time': 1774479142.117943}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978497') HTTP/1.1" 204 0
2026-03-25 22:52:22 [ayvens.be] INFO: Found listing with ID: 1978498
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-25 22:52:22 [ayvens.be] INFO: Scrape type for 1978498: 2
2026-03-25 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1978498
2026-03-25 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-25 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-25 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with scrape type 2
2026-03-25 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5, identifier: 1978498
2026-03-25 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-25 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498
2026-03-25 22:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5 with identifier: 1978498 to the API
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5cd7b9ee-cd1e-52de-8a13-1fdf116b9cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 164918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978498%27 HTTP/1.1" 200 None
2026-03-25 22:52:22 [ayvens.be] INFO: Saving data for 1978498: {'auction_closing_time': 1774854000.0, 'created_time': 1774305972.480469, 'last_price_update_time': 1774479142.574122}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978498') HTTP/1.1" 204 0
2026-03-25 22:52:22 [ayvens.be] INFO: Found listing with ID: 1978499
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-25 22:52:22 [ayvens.be] INFO: Scrape type for 1978499: 2
2026-03-25 22:52:22 [ayvens.be] INFO: Extracting data for car ID: 1978499
2026-03-25 22:52:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-25 22:52:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-25 22:52:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5968da5-a67d-559a-b39a-6df374c8874a with scrape type 2
2026-03-25 22:52:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5968da5-a67d-559a-b39a-6df374c8874a, identifier: 1978499
2026-03-25 22:52:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-25 22:52:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499
2026-03-25 22:52:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5968da5-a67d-559a-b39a-6df374c8874a with identifier: 1978499 to the API
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f5968da5-a67d-559a-b39a-6df374c8874a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER',
 'odometer': 241984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER 1.5 ECOBLUE 85KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 ECOBLUE 85KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978499%27 HTTP/1.1" 200 None
2026-03-25 22:52:22 [ayvens.be] INFO: Saving data for 1978499: {'auction_closing_time': 1774854000.0, 'created_time': 1774305987.735549, 'last_price_update_time': 1774479142.979853}
2026-03-25 22:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978499') HTTP/1.1" 204 0
2026-03-25 22:52:23 [ayvens.be] INFO: Found listing with ID: 1978500
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-25 22:52:23 [ayvens.be] INFO: Scrape type for 1978500: 2
2026-03-25 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1978500
2026-03-25 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-25 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-25 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with scrape type 2
2026-03-25 22:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e, identifier: 1978500
2026-03-25 22:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-25 22:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500
2026-03-25 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 60b24981-ee9c-5f7d-83b3-a07ef1a2a44e with identifier: 1978500 to the API
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '60b24981-ee9c-5f7d-83b3-a07ef1a2a44e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 148389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO ACTIVE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO ACTIVE',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978500%27 HTTP/1.1" 200 None
2026-03-25 22:52:23 [ayvens.be] INFO: Saving data for 1978500: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.559407, 'last_price_update_time': 1774479143.392546}
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978500') HTTP/1.1" 204 0
2026-03-25 22:52:23 [ayvens.be] INFO: Found listing with ID: 1978501
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-25 22:52:23 [ayvens.be] INFO: Scrape type for 1978501: 2
2026-03-25 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1978501
2026-03-25 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-25 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-25 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with scrape type 2
2026-03-25 22:52:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b, identifier: 1978501
2026-03-25 22:52:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-25 22:52:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501
2026-03-25 22:52:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e09cf8b-cc7f-50c5-93b3-18a06f65586b with identifier: 1978501 to the API
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '6e09cf8b-cc7f-50c5-93b3-18a06f65586b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK DIESEL',
 'odometer': 206442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK DIESEL 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978501%27 HTTP/1.1" 200 None
2026-03-25 22:52:23 [ayvens.be] INFO: Saving data for 1978501: {'auction_closing_time': 1774854000.0, 'created_time': 1774305986.20933, 'last_price_update_time': 1774479143.794628}
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978501') HTTP/1.1" 204 0
2026-03-25 22:52:23 [ayvens.be] INFO: Found listing with ID: 1978502
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-25 22:52:23 [ayvens.be] INFO: Scrape type for 1978502: 2
2026-03-25 22:52:23 [ayvens.be] INFO: Extracting data for car ID: 1978502
2026-03-25 22:52:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-25 22:52:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-25 22:52:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with scrape type 2
2026-03-25 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e, identifier: 1978502
2026-03-25 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-25 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502
2026-03-25 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 98fa9be1-2572-5c51-9f7f-a10a53b6d94e with identifier: 1978502 to the API
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '3.2L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '98fa9be1-2572-5c51-9f7f-a10a53b6d94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER DOUBLE CAB - 2015',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER DOUBLE CAB - 2015 3.2 TDCi Wildtrak STOCK',
 'transmission': 'automatic',
 'trim': '3.2 TDCi Wildtrak STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978502%27 HTTP/1.1" 200 None
2026-03-25 22:52:24 [ayvens.be] INFO: Saving data for 1978502: {'auction_closing_time': 1774854000.0, 'created_time': 1774305984.438999, 'last_price_update_time': 1774479144.293657}
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978502') HTTP/1.1" 204 0
2026-03-25 22:52:24 [ayvens.be] INFO: Found listing with ID: 1978503
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-25 22:52:24 [ayvens.be] INFO: Scrape type for 1978503: 2
2026-03-25 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1978503
2026-03-25 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-25 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-25 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3650d538-54de-5675-abe8-1a8e3d40dcb4 with scrape type 2
2026-03-25 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3650d538-54de-5675-abe8-1a8e3d40dcb4, identifier: 1978503
2026-03-25 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-25 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503
2026-03-25 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3650d538-54de-5675-abe8-1a8e3d40dcb4 with identifier: 1978503 to the API
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '3650d538-54de-5675-abe8-1a8e3d40dcb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR - 2016',
 'odometer': 179004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR - 2016 1.33 TCe Corporate Edition GPF '
          '(Fleet)',
 'transmission': 'manual',
 'trim': '1.33 TCe Corporate Edition GPF (Fleet)',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978503%27 HTTP/1.1" 200 None
2026-03-25 22:52:24 [ayvens.be] INFO: Saving data for 1978503: {'auction_closing_time': 1774854000.0, 'created_time': 1774305978.22046, 'last_price_update_time': 1774479144.651694}
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978503') HTTP/1.1" 204 0
2026-03-25 22:52:24 [ayvens.be] INFO: Found listing with ID: 1978504
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-25 22:52:24 [ayvens.be] INFO: Scrape type for 1978504: 2
2026-03-25 22:52:24 [ayvens.be] INFO: Extracting data for car ID: 1978504
2026-03-25 22:52:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-25 22:52:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-25 22:52:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with scrape type 2
2026-03-25 22:52:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a, identifier: 1978504
2026-03-25 22:52:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-25 22:52:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504
2026-03-25 22:52:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3d3b41a-5d5a-5c2a-b915-f10d14e3761a with identifier: 1978504 to the API
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3d3b41a-5d5a-5c2a-b915-f10d14e3761a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 47706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978504%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Saving data for 1978504: {'auction_closing_time': 1774854000.0, 'created_time': 1774305983.222158, 'last_price_update_time': 1774479145.03737}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978504') HTTP/1.1" 204 0
2026-03-25 22:52:25 [ayvens.be] INFO: Found listing with ID: 1978505
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Scrape type for 1978505: 2
2026-03-25 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1978505
2026-03-25 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-25 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406397f1-cca0-5b08-9891-053ec738b4c6 with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 406397f1-cca0-5b08-9891-053ec738b4c6, identifier: 1978505
2026-03-25 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-25 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505
2026-03-25 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 406397f1-cca0-5b08-9891-053ec738b4c6 with identifier: 1978505 to the API
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '406397f1-cca0-5b08-9891-053ec738b4c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 99981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 2.3 DCI 135 L3H2 3.5T ACENTA',
 'transmission': 'manual',
 'trim': '2.3 DCI 135 L3H2 3.5T ACENTA',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978505%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Saving data for 1978505: {'auction_closing_time': 1774854000.0, 'created_time': 1774305980.737247, 'last_price_update_time': 1774479145.415737}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978505') HTTP/1.1" 204 0
2026-03-25 22:52:25 [ayvens.be] INFO: Found listing with ID: 1978506
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Scrape type for 1978506: 2
2026-03-25 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1978506
2026-03-25 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-25 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb, identifier: 1978506
2026-03-25 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-25 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506
2026-03-25 22:52:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67b55a3b-5d0d-522f-b0c3-516eb74e55cb with identifier: 1978506 to the API
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BANQUISE WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b55a3b-5d0d-522f-b0c3-516eb74e55cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 51490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978506%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Saving data for 1978506: {'auction_closing_time': 1774854000.0, 'created_time': 1774305982.460874, 'last_price_update_time': 1774479145.788138}
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978506') HTTP/1.1" 204 0
2026-03-25 22:52:25 [ayvens.be] INFO: Found listing with ID: 1978507
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-25 22:52:25 [ayvens.be] INFO: Scrape type for 1978507: 2
2026-03-25 22:52:25 [ayvens.be] INFO: Extracting data for car ID: 1978507
2026-03-25 22:52:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-25 22:52:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 264afb82-f54a-51f0-ba3b-45f0345ece79 with scrape type 2
2026-03-25 22:52:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 264afb82-f54a-51f0-ba3b-45f0345ece79, identifier: 1978507
2026-03-25 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-25 22:52:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507
2026-03-25 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 264afb82-f54a-51f0-ba3b-45f0345ece79 with identifier: 1978507 to the API
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'REFLEX SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '264afb82-f54a-51f0-ba3b-45f0345ece79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY MAXI VAN DIESEL - 2015',
 'odometer': 160987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY MAXI VAN DIESEL - 2015 2.0 CR TDi SCR (EU6) STOCK',
 'transmission': 'manual',
 'trim': '2.0 CR TDi SCR (EU6) STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978507%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Saving data for 1978507: {'auction_closing_time': 1774854000.0, 'created_time': 1774305985.112254, 'last_price_update_time': 1774479146.202441}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978507') HTTP/1.1" 204 0
2026-03-25 22:52:26 [ayvens.be] INFO: Found listing with ID: 1978508
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Scrape type for 1978508: 2
2026-03-25 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1978508
2026-03-25 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-25 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-25 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with scrape type 2
2026-03-25 22:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2810f775-462c-5d0f-94cf-d0c91b6abcc0, identifier: 1978508
2026-03-25 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-25 22:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508
2026-03-25 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2810f775-462c-5d0f-94cf-d0c91b6abcc0 with identifier: 1978508 to the API
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2810f775-462c-5d0f-94cf-d0c91b6abcc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 136038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'transmission': 'manual',
 'trim': '2.0CRTDI SCR 81KW BMT SWB 2.8T',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978508%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Saving data for 1978508: {'auction_closing_time': 1774854000.0, 'created_time': 1774305988.681362, 'last_price_update_time': 1774479146.577172}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978508') HTTP/1.1" 204 0
2026-03-25 22:52:26 [ayvens.be] INFO: Found listing with ID: 1978509
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Scrape type for 1978509: 2
2026-03-25 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1978509
2026-03-25 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-25 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-25 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36aec582-042b-575e-a443-7a97cbbb0314 with scrape type 2
2026-03-25 22:52:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 36aec582-042b-575e-a443-7a97cbbb0314, identifier: 1978509
2026-03-25 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-25 22:52:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509
2026-03-25 22:52:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 36aec582-042b-575e-a443-7a97cbbb0314 with identifier: 1978509 to the API
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '36aec582-042b-575e-a443-7a97cbbb0314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 181024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978509%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Saving data for 1978509: {'auction_closing_time': 1774854000.0, 'created_time': 1774305991.977314, 'last_price_update_time': 1774479146.965211}
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978509') HTTP/1.1" 204 0
2026-03-25 22:52:26 [ayvens.be] INFO: Found listing with ID: 1978510
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-25 22:52:26 [ayvens.be] INFO: Scrape type for 1978510: 2
2026-03-25 22:52:26 [ayvens.be] INFO: Extracting data for car ID: 1978510
2026-03-25 22:52:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-25 22:52:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-25 22:52:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with scrape type 2
2026-03-25 22:52:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae, identifier: 1978510
2026-03-25 22:52:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-25 22:52:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510
2026-03-25 22:52:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3b7a7ae1-577b-511e-bd30-b9db7a61d7ae with identifier: 1978510 to the API
2026-03-25 22:52:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b7a7ae1-577b-511e-bd30-b9db7a61d7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 63627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978510%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Saving data for 1978510: {'auction_closing_time': 1774854000.0, 'created_time': 1774305993.91192, 'last_price_update_time': 1774479148.078092}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978510') HTTP/1.1" 204 0
2026-03-25 22:52:28 [ayvens.be] INFO: Found listing with ID: 1978511
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Scrape type for 1978511: 2
2026-03-25 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1978511
2026-03-25 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-25 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-25 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841305e5-c403-5982-9930-f2997b99b443 with scrape type 2
2026-03-25 22:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 841305e5-c403-5982-9930-f2997b99b443, identifier: 1978511
2026-03-25 22:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-25 22:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511
2026-03-25 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 841305e5-c403-5982-9930-f2997b99b443 with identifier: 1978511 to the API
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '841305e5-c403-5982-9930-f2997b99b443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 67436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978511%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Saving data for 1978511: {'auction_closing_time': 1774854000.0, 'created_time': 1774305995.04962, 'last_price_update_time': 1774479148.455411}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978511') HTTP/1.1" 204 0
2026-03-25 22:52:28 [ayvens.be] INFO: Found listing with ID: 1978512
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Scrape type for 1978512: 2
2026-03-25 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1978512
2026-03-25 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-25 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-25 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9829e9fa-2169-5fb1-8ddb-3215804f70dd with scrape type 2
2026-03-25 22:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9829e9fa-2169-5fb1-8ddb-3215804f70dd, identifier: 1978512
2026-03-25 22:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-25 22:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512
2026-03-25 22:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9829e9fa-2169-5fb1-8ddb-3215804f70dd with identifier: 1978512 to the API
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '9829e9fa-2169-5fb1-8ddb-3215804f70dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 103547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978512%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Saving data for 1978512: {'auction_closing_time': 1774854000.0, 'created_time': 1774305999.296069, 'last_price_update_time': 1774479148.83013}
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978512') HTTP/1.1" 204 0
2026-03-25 22:52:28 [ayvens.be] INFO: Found listing with ID: 1978513
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-25 22:52:28 [ayvens.be] INFO: Scrape type for 1978513: 2
2026-03-25 22:52:28 [ayvens.be] INFO: Extracting data for car ID: 1978513
2026-03-25 22:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-25 22:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-25 22:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa4f9804-d955-5197-b2eb-cc47ae31219b with scrape type 2
2026-03-25 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fa4f9804-d955-5197-b2eb-cc47ae31219b, identifier: 1978513
2026-03-25 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-25 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513
2026-03-25 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fa4f9804-d955-5197-b2eb-cc47ae31219b with identifier: 1978513 to the API
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa4f9804-d955-5197-b2eb-cc47ae31219b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER 335 FOURGON LWB DSL - 20',
 'odometer': 134594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 FOURGON LWB DSL - 20 2.0 BlueHDi L3H2 Premium S&S '
          'STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3H2 Premium S&S STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978513%27 HTTP/1.1" 200 None
2026-03-25 22:52:29 [ayvens.be] INFO: Saving data for 1978513: {'auction_closing_time': 1774854000.0, 'created_time': 1774306000.783743, 'last_price_update_time': 1774479149.294701}
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978513') HTTP/1.1" 204 0
2026-03-25 22:52:29 [ayvens.be] INFO: Found listing with ID: 1978514
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-25 22:52:29 [ayvens.be] INFO: Scrape type for 1978514: 2
2026-03-25 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1978514
2026-03-25 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-25 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-25 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with scrape type 2
2026-03-25 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 53ec3909-cd1c-501e-97b6-5b22c83a5f97, identifier: 1978514
2026-03-25 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-25 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514
2026-03-25 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 53ec3909-cd1c-501e-97b6-5b22c83a5f97 with identifier: 1978514 to the API
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '53ec3909-cd1c-501e-97b6-5b22c83a5f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS DSL - 2013',
 'odometer': 127138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS DSL - 2013 1.5 Blue dCi Grand Confort '
          '(EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '1.5 Blue dCi Grand Confort (EU6d-TEMP)',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978514%27 HTTP/1.1" 200 None
2026-03-25 22:52:29 [ayvens.be] INFO: Saving data for 1978514: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.979295, 'last_price_update_time': 1774479149.701856}
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978514') HTTP/1.1" 204 0
2026-03-25 22:52:29 [ayvens.be] INFO: Found listing with ID: 1978515
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-25 22:52:29 [ayvens.be] INFO: Scrape type for 1978515: 2
2026-03-25 22:52:29 [ayvens.be] INFO: Extracting data for car ID: 1978515
2026-03-25 22:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-25 22:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-25 22:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeb3a64f-dbc5-5cef-b489-e4111fa7369b with scrape type 2
2026-03-25 22:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eeb3a64f-dbc5-5cef-b489-e4111fa7369b, identifier: 1978515
2026-03-25 22:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-25 22:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515
2026-03-25 22:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eeb3a64f-dbc5-5cef-b489-e4111fa7369b with identifier: 1978515 to the API
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eeb3a64f-dbc5-5cef-b489-e4111fa7369b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60 DIESEL - 2018',
 'odometer': 212523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 DIESEL - 2018 2.0 D3 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum Pro Geartronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978515%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Saving data for 1978515: {'auction_closing_time': 1774854000.0, 'created_time': 1774306007.623923, 'last_price_update_time': 1774479150.078096}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978515') HTTP/1.1" 204 0
2026-03-25 22:52:30 [ayvens.be] INFO: Found listing with ID: 1978516
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Scrape type for 1978516: 2
2026-03-25 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1978516
2026-03-25 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-25 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-25 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30ad7341-5bb4-5f55-a82c-22c04d424124 with scrape type 2
2026-03-25 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30ad7341-5bb4-5f55-a82c-22c04d424124, identifier: 1978516
2026-03-25 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-25 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516
2026-03-25 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30ad7341-5bb4-5f55-a82c-22c04d424124 with identifier: 1978516 to the API
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '30ad7341-5bb4-5f55-a82c-22c04d424124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 174253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 2.0 TDI 85KW STYLE',
 'transmission': 'manual',
 'trim': '2.0 TDI 85KW STYLE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978516%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Saving data for 1978516: {'auction_closing_time': 1774854000.0, 'created_time': 1774306005.759274, 'last_price_update_time': 1774479150.477467}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978516') HTTP/1.1" 204 0
2026-03-25 22:52:30 [ayvens.be] INFO: Found listing with ID: 1978517
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Scrape type for 1978517: 2
2026-03-25 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1978517
2026-03-25 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-25 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-25 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0280571-db56-5f74-9f1d-4dda9eb6af60 with scrape type 2
2026-03-25 22:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c0280571-db56-5f74-9f1d-4dda9eb6af60, identifier: 1978517
2026-03-25 22:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-25 22:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517
2026-03-25 22:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c0280571-db56-5f74-9f1d-4dda9eb6af60 with identifier: 1978517 to the API
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0280571-db56-5f74-9f1d-4dda9eb6af60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 LWB DSL - 2014',
 'odometer': 74808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 LWB DSL - 2014 2.3 dCi 35 L3H1 STOCK',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H1 STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978517%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Saving data for 1978517: {'auction_closing_time': 1774854000.0, 'created_time': 1774306010.844703, 'last_price_update_time': 1774479150.911732}
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978517') HTTP/1.1" 204 0
2026-03-25 22:52:30 [ayvens.be] INFO: Found listing with ID: 1978518
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-25 22:52:30 [ayvens.be] INFO: Scrape type for 1978518: 2
2026-03-25 22:52:30 [ayvens.be] INFO: Extracting data for car ID: 1978518
2026-03-25 22:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-25 22:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-25 22:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e4a439d-7fba-5427-8975-2743b5f404ea with scrape type 2
2026-03-25 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e4a439d-7fba-5427-8975-2743b5f404ea, identifier: 1978518
2026-03-25 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-25 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518
2026-03-25 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e4a439d-7fba-5427-8975-2743b5f404ea with identifier: 1978518 to the API
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e4a439d-7fba-5427-8975-2743b5f404ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 60841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978518%27 HTTP/1.1" 200 None
2026-03-25 22:52:31 [ayvens.be] INFO: Saving data for 1978518: {'auction_closing_time': 1774854000.0, 'created_time': 1774306039.188929, 'last_price_update_time': 1774479151.637788}
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978518') HTTP/1.1" 204 0
2026-03-25 22:52:31 [ayvens.be] INFO: Found listing with ID: 1978519
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-25 22:52:31 [ayvens.be] INFO: Scrape type for 1978519: 2
2026-03-25 22:52:31 [ayvens.be] INFO: Extracting data for car ID: 1978519
2026-03-25 22:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-25 22:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-25 22:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with scrape type 2
2026-03-25 22:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377, identifier: 1978519
2026-03-25 22:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-25 22:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519
2026-03-25 22:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 32f2c5d7-05a7-5ac7-9808-a1ed87f59377 with identifier: 1978519 to the API
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '32f2c5d7-05a7-5ac7-9808-a1ed87f59377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 68596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978519%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Saving data for 1978519: {'auction_closing_time': 1774854000.0, 'created_time': 1774306014.883411, 'last_price_update_time': 1774479152.010035}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978519') HTTP/1.1" 204 0
2026-03-25 22:52:32 [ayvens.be] INFO: Found listing with ID: 1978520
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Scrape type for 1978520: 2
2026-03-25 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1978520
2026-03-25 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-25 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 417a8c56-af9b-521e-b580-3853cf048285 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 417a8c56-af9b-521e-b580-3853cf048285, identifier: 1978520
2026-03-25 22:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-25 22:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520
2026-03-25 22:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 417a8c56-af9b-521e-b580-3853cf048285 with identifier: 1978520 to the API
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '417a8c56-af9b-521e-b580-3853cf048285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 70125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978520%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Saving data for 1978520: {'auction_closing_time': 1774854000.0, 'created_time': 1774306037.541312, 'last_price_update_time': 1774479152.379786}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978520') HTTP/1.1" 204 0
2026-03-25 22:52:32 [ayvens.be] INFO: Found listing with ID: 1978521
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Scrape type for 1978521: 2
2026-03-25 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1978521
2026-03-25 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-25 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2, identifier: 1978521
2026-03-25 22:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-25 22:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521
2026-03-25 22:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2 with identifier: 1978521 to the API
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5f14ab2-e5b0-5112-9c0c-5c37fef1f5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 177788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978521%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Saving data for 1978521: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.959733, 'last_price_update_time': 1774479152.738171}
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978521') HTTP/1.1" 204 0
2026-03-25 22:52:32 [ayvens.be] INFO: Found listing with ID: 1978522
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-25 22:52:32 [ayvens.be] INFO: Scrape type for 1978522: 2
2026-03-25 22:52:32 [ayvens.be] INFO: Extracting data for car ID: 1978522
2026-03-25 22:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-25 22:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with scrape type 2
2026-03-25 22:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2ac3d0d6-67e5-51de-9d44-61670661c6f7, identifier: 1978522
2026-03-25 22:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-25 22:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522
2026-03-25 22:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2ac3d0d6-67e5-51de-9d44-61670661c6f7 with identifier: 1978522 to the API
2026-03-25 22:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '2ac3d0d6-67e5-51de-9d44-61670661c6f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 103529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L3 Long Premium '
          'S&S STOCK',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi L3 Long Premium S&S STOCK',
 'vin': None,
 'year': 2017}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978522%27 HTTP/1.1" 200 None
2026-03-25 22:52:33 [ayvens.be] INFO: Saving data for 1978522: {'auction_closing_time': 1774854000.0, 'created_time': 1774306020.045803, 'last_price_update_time': 1774479153.141037}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978522') HTTP/1.1" 204 0
2026-03-25 22:52:33 [ayvens.be] INFO: Found listing with ID: 1978523
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-25 22:52:33 [ayvens.be] INFO: Scrape type for 1978523: 2
2026-03-25 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1978523
2026-03-25 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-25 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-25 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 621c8a2c-56ec-533e-8c87-ae145ea4084a with scrape type 2
2026-03-25 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 621c8a2c-56ec-533e-8c87-ae145ea4084a, identifier: 1978523
2026-03-25 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-25 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523
2026-03-25 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 621c8a2c-56ec-533e-8c87-ae145ea4084a with identifier: 1978523 to the API
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '621c8a2c-56ec-533e-8c87-ae145ea4084a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 137312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978523%27 HTTP/1.1" 200 None
2026-03-25 22:52:33 [ayvens.be] INFO: Saving data for 1978523: {'auction_closing_time': 1774854000.0, 'created_time': 1774306019.346682, 'last_price_update_time': 1774479153.508431}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978523') HTTP/1.1" 204 0
2026-03-25 22:52:33 [ayvens.be] INFO: Found listing with ID: 1978524
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-25 22:52:33 [ayvens.be] INFO: Scrape type for 1978524: 2
2026-03-25 22:52:33 [ayvens.be] INFO: Extracting data for car ID: 1978524
2026-03-25 22:52:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-25 22:52:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-25 22:52:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede80ffc-fa67-520c-8216-015908eb4f94 with scrape type 2
2026-03-25 22:52:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ede80ffc-fa67-520c-8216-015908eb4f94, identifier: 1978524
2026-03-25 22:52:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-25 22:52:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524
2026-03-25 22:52:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ede80ffc-fa67-520c-8216-015908eb4f94 with identifier: 1978524 to the API
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLANC NACRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ede80ffc-fa67-520c-8216-015908eb4f94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2017',
 'odometer': 145157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2017 1.5 BlueHDi Allure (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978524%27 HTTP/1.1" 200 None
2026-03-25 22:52:33 [ayvens.be] INFO: Saving data for 1978524: {'auction_closing_time': 1774854000.0, 'created_time': 1774306022.124021, 'last_price_update_time': 1774479153.969436}
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978524') HTTP/1.1" 204 0
2026-03-25 22:52:33 [ayvens.be] INFO: Found listing with ID: 1978525
2026-03-25 22:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-25 22:52:34 [ayvens.be] INFO: Scrape type for 1978525: 2
2026-03-25 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1978525
2026-03-25 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-25 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c162cd1b-f0a8-5d66-aa9d-858044663a69 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c162cd1b-f0a8-5d66-aa9d-858044663a69, identifier: 1978525
2026-03-25 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-25 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525
2026-03-25 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c162cd1b-f0a8-5d66-aa9d-858044663a69 with identifier: 1978525 to the API
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c162cd1b-f0a8-5d66-aa9d-858044663a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 100509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-14',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978525%27 HTTP/1.1" 200 None
2026-03-25 22:52:34 [ayvens.be] INFO: Saving data for 1978525: {'auction_closing_time': 1774854000.0, 'created_time': 1774306024.823426, 'last_price_update_time': 1774479154.32911}
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978525') HTTP/1.1" 204 0
2026-03-25 22:52:34 [ayvens.be] INFO: Found listing with ID: 1978526
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-25 22:52:34 [ayvens.be] INFO: Scrape type for 1978526: 2
2026-03-25 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1978526
2026-03-25 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-25 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7, identifier: 1978526
2026-03-25 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-25 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526
2026-03-25 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7 with identifier: 1978526 to the API
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '7b7fc583-cd99-5b42-b0df-f3c3aa4d6cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HR DSL',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HR DSL 2.0 TDCi L3H2 Trend',
 'transmission': 'automatic',
 'trim': '2.0 TDCi L3H2 Trend',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978526%27 HTTP/1.1" 200 None
2026-03-25 22:52:34 [ayvens.be] INFO: Saving data for 1978526: {'auction_closing_time': 1774854000.0, 'created_time': 1774306032.150657, 'last_price_update_time': 1774479154.708889}
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978526') HTTP/1.1" 204 0
2026-03-25 22:52:34 [ayvens.be] INFO: Found listing with ID: 1978527
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-25 22:52:34 [ayvens.be] INFO: Scrape type for 1978527: 2
2026-03-25 22:52:34 [ayvens.be] INFO: Extracting data for car ID: 1978527
2026-03-25 22:52:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-25 22:52:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with scrape type 2
2026-03-25 22:52:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8, identifier: 1978527
2026-03-25 22:52:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-25 22:52:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527
2026-03-25 22:52:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 74ae79bb-c687-5941-80f0-bb5bc5a8f0e8 with identifier: 1978527 to the API
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '74ae79bb-c687-5941-80f0-bb5bc5a8f0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 133993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978527%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Saving data for 1978527: {'auction_closing_time': 1774854000.0, 'created_time': 1774306027.420883, 'last_price_update_time': 1774479155.088397}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978527') HTTP/1.1" 204 0
2026-03-25 22:52:35 [ayvens.be] INFO: Found listing with ID: 1978528
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Scrape type for 1978528: 2
2026-03-25 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1978528
2026-03-25 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-25 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85a756ef-87cd-5fbf-967b-f33557744fc5 with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85a756ef-87cd-5fbf-967b-f33557744fc5, identifier: 1978528
2026-03-25 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-25 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528
2026-03-25 22:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85a756ef-87cd-5fbf-967b-f33557744fc5 with identifier: 1978528 to the API
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '85a756ef-87cd-5fbf-967b-f33557744fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 54570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978528%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Saving data for 1978528: {'auction_closing_time': 1774854000.0, 'created_time': 1774306029.160378, 'last_price_update_time': 1774479155.457977}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978528') HTTP/1.1" 204 0
2026-03-25 22:52:35 [ayvens.be] INFO: Found listing with ID: 1978529
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Scrape type for 1978529: 2
2026-03-25 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1978529
2026-03-25 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-25 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce6f2a4e-0964-55ca-a00b-00998c38e97b with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce6f2a4e-0964-55ca-a00b-00998c38e97b, identifier: 1978529
2026-03-25 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-25 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529
2026-03-25 22:52:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce6f2a4e-0964-55ca-a00b-00998c38e97b with identifier: 1978529 to the API
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce6f2a4e-0964-55ca-a00b-00998c38e97b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 212761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978529%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Saving data for 1978529: {'auction_closing_time': 1774854000.0, 'created_time': 1774306031.397081, 'last_price_update_time': 1774479155.819688}
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978529') HTTP/1.1" 204 0
2026-03-25 22:52:35 [ayvens.be] INFO: Found listing with ID: 1978530
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-25 22:52:35 [ayvens.be] INFO: Scrape type for 1978530: 2
2026-03-25 22:52:35 [ayvens.be] INFO: Extracting data for car ID: 1978530
2026-03-25 22:52:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-25 22:52:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63a7700a-9aab-5b25-81db-fb8e247c112d with scrape type 2
2026-03-25 22:52:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63a7700a-9aab-5b25-81db-fb8e247c112d, identifier: 1978530
2026-03-25 22:52:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-25 22:52:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530
2026-03-25 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63a7700a-9aab-5b25-81db-fb8e247c112d with identifier: 1978530 to the API
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'petrol',
 'id': '63a7700a-9aab-5b25-81db-fb8e247c112d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN',
 'odometer': 124374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN 1.4 EHYBRID PHEV DSG ENERGETIC',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG ENERGETIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978530%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Saving data for 1978530: {'auction_closing_time': 1774854000.0, 'created_time': 1774306033.824887, 'last_price_update_time': 1774479156.19345}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978530') HTTP/1.1" 204 0
2026-03-25 22:52:36 [ayvens.be] INFO: Found listing with ID: 1978531
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Scrape type for 1978531: 2
2026-03-25 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1978531
2026-03-25 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-25 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-25 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c85626-29d2-535a-8e62-d33afc1b51be with scrape type 2
2026-03-25 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 73c85626-29d2-535a-8e62-d33afc1b51be, identifier: 1978531
2026-03-25 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-25 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531
2026-03-25 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 73c85626-29d2-535a-8e62-d33afc1b51be with identifier: 1978531 to the API
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': '73c85626-29d2-535a-8e62-d33afc1b51be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER 1400 FOU LWB DSL -',
 'odometer': 212303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 1400 FOU LWB DSL - 2.0 TDi SCR 4Motion BMT '
          'DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi SCR 4Motion BMT DSG',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978531%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Saving data for 1978531: {'auction_closing_time': 1774854000.0, 'created_time': 1774306035.537882, 'last_price_update_time': 1774479156.566835}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978531') HTTP/1.1" 204 0
2026-03-25 22:52:36 [ayvens.be] INFO: Found listing with ID: 1978532
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Scrape type for 1978532: 2
2026-03-25 22:52:36 [ayvens.be] INFO: Extracting data for car ID: 1978532
2026-03-25 22:52:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-25 22:52:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-25 22:52:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with scrape type 2
2026-03-25 22:52:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f, identifier: 1978532
2026-03-25 22:52:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-25 22:52:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532
2026-03-25 22:52:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f with identifier: 1978532 to the API
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-30T07:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f78ca9b8-6ba8-5b62-a87e-d07ef5e0df5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40932',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 36721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978532%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Saving data for 1978532: {'auction_closing_time': 1774854000.0, 'created_time': 1774306036.684049, 'last_price_update_time': 1774479156.936197}
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1978532') HTTP/1.1" 204 0
2026-03-25 22:52:36 [ayvens.be] INFO: Found listing with ID: 1978542
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978542%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Scrape type for 1978542: 0
2026-03-25 22:52:36 [ayvens.be] INFO: Found listing with ID: 1978543
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978543%27 HTTP/1.1" 200 None
2026-03-25 22:52:36 [ayvens.be] INFO: Scrape type for 1978543: 0
2026-03-25 22:52:36 [ayvens.be] INFO: Found listing with ID: 1978544
2026-03-25 22:52:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978544%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978544: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978545
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978545%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978545: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978546
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978546%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978546: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978547
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978547%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978547: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978548
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978548%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978548: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978549
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978549%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978549: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978550
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978550%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978550: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978551
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978551%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978551: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978552
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978552%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978552: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978553
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978553%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978553: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978554
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978554%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978554: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978555
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978555%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978555: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978556
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978556%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978556: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978557
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978557%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978557: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978558
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978558%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978558: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978559
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978559%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978559: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978560
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978560%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978560: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978561
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978561%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978561: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978562
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978562%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978562: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978563
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978563%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978563: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978564
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978564%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978564: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Found listing with ID: 1978565
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978565%27 HTTP/1.1" 200 None
2026-03-25 22:52:37 [ayvens.be] INFO: Scrape type for 1978565: 0
2026-03-25 22:52:37 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-25 22:52:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:52:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978566
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978566%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978566: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978567
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978567%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978567: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978568
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978568%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978568: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978569
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978569%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978569: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978570
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978570%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978570: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978571
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978571%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978571: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1978572
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271978572%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1978572: 0
2026-03-25 22:52:39 [ayvens.be] INFO: Found listing with ID: 1977588
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Scrape type for 1977588: 2
2026-03-25 22:52:39 [ayvens.be] INFO: Extracting data for car ID: 1977588
2026-03-25 22:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-25 22:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-25 22:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb2b1fe-1187-5175-98ae-c32eb513fadd with scrape type 2
2026-03-25 22:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: abb2b1fe-1187-5175-98ae-c32eb513fadd, identifier: 1977588
2026-03-25 22:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-25 22:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588
2026-03-25 22:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: abb2b1fe-1187-5175-98ae-c32eb513fadd with identifier: 1977588 to the API
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'abb2b1fe-1187-5175-98ae-c32eb513fadd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 48824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977588%27 HTTP/1.1" 200 None
2026-03-25 22:52:39 [ayvens.be] INFO: Saving data for 1977588: {'auction_closing_time': 1774600200.0, 'created_time': 1774306041.233719, 'last_price_update_time': 1774479159.941065}
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977588') HTTP/1.1" 204 0
2026-03-25 22:52:40 [ayvens.be] INFO: Found listing with ID: 1977589
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-25 22:52:40 [ayvens.be] INFO: Scrape type for 1977589: 2
2026-03-25 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1977589
2026-03-25 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-25 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca, identifier: 1977589
2026-03-25 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-25 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589
2026-03-25 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5bd88324-1259-50cd-b0e6-dc66d9bc91ca with identifier: 1977589 to the API
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5bd88324-1259-50cd-b0e6-dc66d9bc91ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 138981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977589%27 HTTP/1.1" 200 None
2026-03-25 22:52:40 [ayvens.be] INFO: Saving data for 1977589: {'auction_closing_time': 1774600200.0, 'created_time': 1774306043.050818, 'last_price_update_time': 1774479160.421543}
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977589') HTTP/1.1" 204 0
2026-03-25 22:52:40 [ayvens.be] INFO: Found listing with ID: 1977590
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-25 22:52:40 [ayvens.be] INFO: Scrape type for 1977590: 2
2026-03-25 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1977590
2026-03-25 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-25 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 932666f8-0f6a-5088-b3d6-cbe5b8a89457, identifier: 1977590
2026-03-25 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-25 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590
2026-03-25 22:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 932666f8-0f6a-5088-b3d6-cbe5b8a89457 with identifier: 1977590 to the API
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '932666f8-0f6a-5088-b3d6-cbe5b8a89457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 51223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO 1.3 TCE 130 TECHNO',
 'transmission': 'manual',
 'trim': '1.3 TCE 130 TECHNO',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977590%27 HTTP/1.1" 200 None
2026-03-25 22:52:40 [ayvens.be] INFO: Saving data for 1977590: {'auction_closing_time': 1774600200.0, 'created_time': 1774306042.219191, 'last_price_update_time': 1774479160.789197}
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977590') HTTP/1.1" 204 0
2026-03-25 22:52:40 [ayvens.be] INFO: Found listing with ID: 1977591
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-25 22:52:40 [ayvens.be] INFO: Scrape type for 1977591: 2
2026-03-25 22:52:40 [ayvens.be] INFO: Extracting data for car ID: 1977591
2026-03-25 22:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-25 22:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d4de2a-4015-517f-96a4-5e1712ae4e3c with scrape type 2
2026-03-25 22:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34d4de2a-4015-517f-96a4-5e1712ae4e3c, identifier: 1977591
2026-03-25 22:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-25 22:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591
2026-03-25 22:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34d4de2a-4015-517f-96a4-5e1712ae4e3c with identifier: 1977591 to the API
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '34d4de2a-4015-517f-96a4-5e1712ae4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 DIESEL - 2018',
 'odometer': 171581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 DIESEL - 2018 1.5 BlueHDi Allure S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure S&S',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977591%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Saving data for 1977591: {'auction_closing_time': 1774600200.0, 'created_time': 1774306044.059916, 'last_price_update_time': 1774479161.180566}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977591') HTTP/1.1" 204 0
2026-03-25 22:52:41 [ayvens.be] INFO: Found listing with ID: 1977592
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Scrape type for 1977592: 2
2026-03-25 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1977592
2026-03-25 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-25 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-25 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d850c4ed-2023-5c25-a4d6-4cd243c4fccc with scrape type 2
2026-03-25 22:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d850c4ed-2023-5c25-a4d6-4cd243c4fccc, identifier: 1977592
2026-03-25 22:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-25 22:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592
2026-03-25 22:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d850c4ed-2023-5c25-a4d6-4cd243c4fccc with identifier: 1977592 to the API
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd850c4ed-2023-5c25-a4d6-4cd243c4fccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 64414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977592%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Saving data for 1977592: {'auction_closing_time': 1774600200.0, 'created_time': 1774306045.966308, 'last_price_update_time': 1774479161.56102}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977592') HTTP/1.1" 204 0
2026-03-25 22:52:41 [ayvens.be] INFO: Found listing with ID: 1977593
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Scrape type for 1977593: 2
2026-03-25 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1977593
2026-03-25 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-25 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-25 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e90ffccc-9938-5977-bc0e-6e08036ae069 with scrape type 2
2026-03-25 22:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e90ffccc-9938-5977-bc0e-6e08036ae069, identifier: 1977593
2026-03-25 22:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-25 22:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593
2026-03-25 22:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e90ffccc-9938-5977-bc0e-6e08036ae069 with identifier: 1977593 to the API
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e90ffccc-9938-5977-bc0e-6e08036ae069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII - 2017',
 'odometer': 77662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII - 2017 1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI IQ.Drive OPF (EU6.2) STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977593%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Saving data for 1977593: {'auction_closing_time': 1774600200.0, 'created_time': 1774306047.666412, 'last_price_update_time': 1774479161.924173}
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977593') HTTP/1.1" 204 0
2026-03-25 22:52:41 [ayvens.be] INFO: Found listing with ID: 1977594
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-25 22:52:41 [ayvens.be] INFO: Scrape type for 1977594: 2
2026-03-25 22:52:41 [ayvens.be] INFO: Extracting data for car ID: 1977594
2026-03-25 22:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-25 22:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-25 22:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with scrape type 2
2026-03-25 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a96b1911-50f3-590a-a4ec-e5a03ecf00e9, identifier: 1977594
2026-03-25 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-25 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594
2026-03-25 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a96b1911-50f3-590a-a4ec-e5a03ecf00e9 with identifier: 1977594 to the API
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a96b1911-50f3-590a-a4ec-e5a03ecf00e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 74135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.5 TSI ACT 110KW DSG7 STYLE',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT 110KW DSG7 STYLE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977594%27 HTTP/1.1" 200 None
2026-03-25 22:52:42 [ayvens.be] INFO: Saving data for 1977594: {'auction_closing_time': 1774600200.0, 'created_time': 1774306048.761324, 'last_price_update_time': 1774479162.289006}
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977594') HTTP/1.1" 204 0
2026-03-25 22:52:42 [ayvens.be] INFO: Found listing with ID: 1977595
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-25 22:52:42 [ayvens.be] INFO: Scrape type for 1977595: 2
2026-03-25 22:52:42 [ayvens.be] INFO: Extracting data for car ID: 1977595
2026-03-25 22:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-25 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-25 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f10890-fbfa-5c4d-bf38-f27198dee1ba with scrape type 2
2026-03-25 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0f10890-fbfa-5c4d-bf38-f27198dee1ba, identifier: 1977595
2026-03-25 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-25 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595
2026-03-25 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0f10890-fbfa-5c4d-bf38-f27198dee1ba with identifier: 1977595 to the API
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd0f10890-fbfa-5c4d-bf38-f27198dee1ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 89450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977595%27 HTTP/1.1" 200 None
2026-03-25 22:52:42 [ayvens.be] INFO: Saving data for 1977595: {'auction_closing_time': 1774600200.0, 'created_time': 1774306051.293206, 'last_price_update_time': 1774479162.648808}
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977595') HTTP/1.1" 204 0
2026-03-25 22:52:42 [ayvens.be] INFO: Found listing with ID: 1977596
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-25 22:52:42 [ayvens.be] INFO: Scrape type for 1977596: 2
2026-03-25 22:52:42 [ayvens.be] INFO: Extracting data for car ID: 1977596
2026-03-25 22:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-25 22:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-25 22:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37963a9-72b0-56df-9d20-931da101e100 with scrape type 2
2026-03-25 22:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e37963a9-72b0-56df-9d20-931da101e100, identifier: 1977596
2026-03-25 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-25 22:52:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596
2026-03-25 22:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e37963a9-72b0-56df-9d20-931da101e100 with identifier: 1977596 to the API
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GRIS MOUSSON',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e37963a9-72b0-56df-9d20-931da101e100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK DIESEL - 2017',
 'odometer': 99196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK DIESEL - 2017 35 TDi Business Ed. Sport S '
          'tr.(EU6d-T.) STOCK',
 'transmission': 'automatic',
 'trim': '35 TDi Business Ed. Sport S tr.(EU6d-T.) STOCK',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977596%27 HTTP/1.1" 200 None
2026-03-25 22:52:43 [ayvens.be] INFO: Saving data for 1977596: {'auction_closing_time': 1774600200.0, 'created_time': 1774306052.808567, 'last_price_update_time': 1774479163.039193}
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977596') HTTP/1.1" 204 0
2026-03-25 22:52:43 [ayvens.be] INFO: Found listing with ID: 1977597
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-25 22:52:43 [ayvens.be] INFO: Scrape type for 1977597: 2
2026-03-25 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1977597
2026-03-25 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-25 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-25 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bce7930-7026-5318-9fe3-ebf52b3266a2 with scrape type 2
2026-03-25 22:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4bce7930-7026-5318-9fe3-ebf52b3266a2, identifier: 1977597
2026-03-25 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-25 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597
2026-03-25 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4bce7930-7026-5318-9fe3-ebf52b3266a2 with identifier: 1977597 to the API
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MYTHOSZWART METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '4bce7930-7026-5318-9fe3-ebf52b3266a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON SPORTBACK',
 'odometer': 62593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON SPORTBACK BEV 95KWH 55 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO S-LINE',
 'vin': None,
 'year': 2023}
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977597%27 HTTP/1.1" 200 None
2026-03-25 22:52:43 [ayvens.be] INFO: Saving data for 1977597: {'auction_closing_time': 1774600200.0, 'created_time': 1774306053.788242, 'last_price_update_time': 1774479163.710459}
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977597') HTTP/1.1" 204 0
2026-03-25 22:52:43 [ayvens.be] INFO: Found listing with ID: 1977598
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-25 22:52:43 [ayvens.be] INFO: Scrape type for 1977598: 2
2026-03-25 22:52:43 [ayvens.be] INFO: Extracting data for car ID: 1977598
2026-03-25 22:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-25 22:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-25 22:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f49b01-1325-5392-9f15-deff8c69e130 with scrape type 2
2026-03-25 22:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f7f49b01-1325-5392-9f15-deff8c69e130, identifier: 1977598
2026-03-25 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-25 22:52:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598
2026-03-25 22:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f7f49b01-1325-5392-9f15-deff8c69e130 with identifier: 1977598 to the API
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'ARTENSE GRIJS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f7f49b01-1325-5392-9f15-deff8c69e130',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 53762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977598%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Saving data for 1977598: {'auction_closing_time': 1774600200.0, 'created_time': 1774306055.985428, 'last_price_update_time': 1774479164.100008}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977598') HTTP/1.1" 204 0
2026-03-25 22:52:44 [ayvens.be] INFO: Found listing with ID: 1977599
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Scrape type for 1977599: 2
2026-03-25 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1977599
2026-03-25 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-25 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-25 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d482a2f-1d47-5029-ac61-56fc91746d15 with scrape type 2
2026-03-25 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6d482a2f-1d47-5029-ac61-56fc91746d15, identifier: 1977599
2026-03-25 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-25 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599
2026-03-25 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6d482a2f-1d47-5029-ac61-56fc91746d15 with identifier: 1977599 to the API
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6d482a2f-1d47-5029-ac61-56fc91746d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Sprinter',
 'odometer': 57018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Sprinter 314 2.1 BlueTEC A1 (EU6)',
 'transmission': 'manual',
 'trim': '314 2.1 BlueTEC A1 (EU6)',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977599%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Saving data for 1977599: {'auction_closing_time': 1774600200.0, 'created_time': 1774306057.470995, 'last_price_update_time': 1774479164.467017}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977599') HTTP/1.1" 204 0
2026-03-25 22:52:44 [ayvens.be] INFO: Found listing with ID: 1977600
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Scrape type for 1977600: 2
2026-03-25 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1977600
2026-03-25 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-25 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-25 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2af76393-e37f-5faf-b1cf-9c20ca7639fc with scrape type 2
2026-03-25 22:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2af76393-e37f-5faf-b1cf-9c20ca7639fc, identifier: 1977600
2026-03-25 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-25 22:52:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600
2026-03-25 22:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2af76393-e37f-5faf-b1cf-9c20ca7639fc with identifier: 1977600 to the API
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2af76393-e37f-5faf-b1cf-9c20ca7639fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-Klasse Cabrio',
 'odometer': 144788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-Klasse Cabrio C 200 4-Matic Mild Hybrid',
 'transmission': 'automatic',
 'trim': 'C 200 4-Matic Mild Hybrid',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977600%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Saving data for 1977600: {'auction_closing_time': 1774600200.0, 'created_time': 1774306058.958671, 'last_price_update_time': 1774479164.946076}
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977600') HTTP/1.1" 204 0
2026-03-25 22:52:44 [ayvens.be] INFO: Found listing with ID: 1977601
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-25 22:52:44 [ayvens.be] INFO: Scrape type for 1977601: 2
2026-03-25 22:52:44 [ayvens.be] INFO: Extracting data for car ID: 1977601
2026-03-25 22:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-25 22:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-25 22:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56df818-8bf0-5f81-a7da-fe9cad171e2e with scrape type 2
2026-03-25 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f56df818-8bf0-5f81-a7da-fe9cad171e2e, identifier: 1977601
2026-03-25 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-25 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601
2026-03-25 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f56df818-8bf0-5f81-a7da-fe9cad171e2e with identifier: 1977601 to the API
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'DEEP BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f56df818-8bf0-5f81-a7da-fe9cad171e2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 62743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977601%27 HTTP/1.1" 200 None
2026-03-25 22:52:45 [ayvens.be] INFO: Saving data for 1977601: {'auction_closing_time': 1774600200.0, 'created_time': 1774306060.155854, 'last_price_update_time': 1774479165.321898}
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977601') HTTP/1.1" 204 0
2026-03-25 22:52:45 [ayvens.be] INFO: Found listing with ID: 1977602
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-25 22:52:45 [ayvens.be] INFO: Scrape type for 1977602: 2
2026-03-25 22:52:45 [ayvens.be] INFO: Extracting data for car ID: 1977602
2026-03-25 22:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-25 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-25 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2941fa4c-aec4-50a6-98af-7473d002cb85 with scrape type 2
2026-03-25 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2941fa4c-aec4-50a6-98af-7473d002cb85, identifier: 1977602
2026-03-25 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-25 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602
2026-03-25 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2941fa4c-aec4-50a6-98af-7473d002cb85 with identifier: 1977602 to the API
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2941fa4c-aec4-50a6-98af-7473d002cb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 44418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 1.5 TSI ELEGANCE BUSINESS',
 'transmission': 'manual',
 'trim': '1.5 TSI ELEGANCE BUSINESS',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977602%27 HTTP/1.1" 200 None
2026-03-25 22:52:45 [ayvens.be] INFO: Saving data for 1977602: {'auction_closing_time': 1774600200.0, 'created_time': 1774306061.734184, 'last_price_update_time': 1774479165.687178}
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977602') HTTP/1.1" 204 0
2026-03-25 22:52:45 [ayvens.be] INFO: Found listing with ID: 1977603
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-25 22:52:45 [ayvens.be] INFO: Scrape type for 1977603: 2
2026-03-25 22:52:45 [ayvens.be] INFO: Extracting data for car ID: 1977603
2026-03-25 22:52:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-25 22:52:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-25 22:52:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a835356a-e1ff-5562-82aa-d8865b27de10 with scrape type 2
2026-03-25 22:52:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a835356a-e1ff-5562-82aa-d8865b27de10, identifier: 1977603
2026-03-25 22:52:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-25 22:52:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603
2026-03-25 22:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a835356a-e1ff-5562-82aa-d8865b27de10 with identifier: 1977603 to the API
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a835356a-e1ff-5562-82aa-d8865b27de10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 118295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 40 TDi Quattro Business Ed.Sport S tr.',
 'transmission': 'automatic',
 'trim': '40 TDi Quattro Business Ed.Sport S tr.',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977603%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Saving data for 1977603: {'auction_closing_time': 1774600200.0, 'created_time': 1774306063.588895, 'last_price_update_time': 1774479166.057477}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977603') HTTP/1.1" 204 0
2026-03-25 22:52:46 [ayvens.be] INFO: Found listing with ID: 1977604
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Scrape type for 1977604: 2
2026-03-25 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1977604
2026-03-25 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-25 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6f24ed-99e1-5ec3-9106-1655f246e37e with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a6f24ed-99e1-5ec3-9106-1655f246e37e, identifier: 1977604
2026-03-25 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-25 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604
2026-03-25 22:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a6f24ed-99e1-5ec3-9106-1655f246e37e with identifier: 1977604 to the API
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7a6f24ed-99e1-5ec3-9106-1655f246e37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 138907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 2.0iA sDrive20 OPF',
 'transmission': 'automatic',
 'trim': '2.0iA sDrive20 OPF',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977604%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Saving data for 1977604: {'auction_closing_time': 1774600200.0, 'created_time': 1774306066.166069, 'last_price_update_time': 1774479166.447737}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977604') HTTP/1.1" 204 0
2026-03-25 22:52:46 [ayvens.be] INFO: Found listing with ID: 1977605
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Scrape type for 1977605: 2
2026-03-25 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1977605
2026-03-25 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-25 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c18e68-edc9-57f6-9299-53c5e886f251 with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 75c18e68-edc9-57f6-9299-53c5e886f251, identifier: 1977605
2026-03-25 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-25 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605
2026-03-25 22:52:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 75c18e68-edc9-57f6-9299-53c5e886f251 with identifier: 1977605 to the API
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '75c18e68-edc9-57f6-9299-53c5e886f251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 109624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977605%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Saving data for 1977605: {'auction_closing_time': 1774600200.0, 'created_time': 1774306067.417949, 'last_price_update_time': 1774479166.833872}
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977605') HTTP/1.1" 204 0
2026-03-25 22:52:46 [ayvens.be] INFO: Found listing with ID: 1977606
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-25 22:52:46 [ayvens.be] INFO: Scrape type for 1977606: 2
2026-03-25 22:52:46 [ayvens.be] INFO: Extracting data for car ID: 1977606
2026-03-25 22:52:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-25 22:52:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eb65c18-35ff-5232-bfe6-c831d5449f2f with scrape type 2
2026-03-25 22:52:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8eb65c18-35ff-5232-bfe6-c831d5449f2f, identifier: 1977606
2026-03-25 22:52:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-25 22:52:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606
2026-03-25 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8eb65c18-35ff-5232-bfe6-c831d5449f2f with identifier: 1977606 to the API
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8eb65c18-35ff-5232-bfe6-c831d5449f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 102353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977606%27 HTTP/1.1" 200 None
2026-03-25 22:52:47 [ayvens.be] INFO: Saving data for 1977606: {'auction_closing_time': 1774600200.0, 'created_time': 1774306068.461204, 'last_price_update_time': 1774479167.209807}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977606') HTTP/1.1" 204 0
2026-03-25 22:52:47 [ayvens.be] INFO: Found listing with ID: 1977607
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-25 22:52:47 [ayvens.be] INFO: Scrape type for 1977607: 2
2026-03-25 22:52:47 [ayvens.be] INFO: Extracting data for car ID: 1977607
2026-03-25 22:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-25 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-25 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040d6a37-0b66-560e-b090-0f631aedcd26 with scrape type 2
2026-03-25 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 040d6a37-0b66-560e-b090-0f631aedcd26, identifier: 1977607
2026-03-25 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-25 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607
2026-03-25 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 040d6a37-0b66-560e-b090-0f631aedcd26 with identifier: 1977607 to the API
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '040d6a37-0b66-560e-b090-0f631aedcd26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 174382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977607%27 HTTP/1.1" 200 None
2026-03-25 22:52:47 [ayvens.be] INFO: Saving data for 1977607: {'auction_closing_time': 1774600200.0, 'created_time': 1774306071.071824, 'last_price_update_time': 1774479167.599667}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977607') HTTP/1.1" 204 0
2026-03-25 22:52:47 [ayvens.be] INFO: Found listing with ID: 1977608
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-25 22:52:47 [ayvens.be] INFO: Scrape type for 1977608: 2
2026-03-25 22:52:47 [ayvens.be] INFO: Extracting data for car ID: 1977608
2026-03-25 22:52:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-25 22:52:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-25 22:52:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260a2c51-3acb-5bbf-942b-982a18ca0c65 with scrape type 2
2026-03-25 22:52:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 260a2c51-3acb-5bbf-942b-982a18ca0c65, identifier: 1977608
2026-03-25 22:52:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-25 22:52:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608
2026-03-25 22:52:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 260a2c51-3acb-5bbf-942b-982a18ca0c65 with identifier: 1977608 to the API
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '260a2c51-3acb-5bbf-942b-982a18ca0c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 63063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 316DA (90KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 316DA (90KW) BERLINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977608%27 HTTP/1.1" 200 None
2026-03-25 22:52:47 [ayvens.be] INFO: Saving data for 1977608: {'auction_closing_time': 1774600200.0, 'created_time': 1774306072.397655, 'last_price_update_time': 1774479167.985195}
2026-03-25 22:52:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977608') HTTP/1.1" 204 0
2026-03-25 22:52:48 [ayvens.be] INFO: Found listing with ID: 1977609
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-25 22:52:48 [ayvens.be] INFO: Scrape type for 1977609: 2
2026-03-25 22:52:48 [ayvens.be] INFO: Extracting data for car ID: 1977609
2026-03-25 22:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-25 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37431d50-cf72-5885-afd9-523d39342c72 with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37431d50-cf72-5885-afd9-523d39342c72, identifier: 1977609
2026-03-25 22:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-25 22:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609
2026-03-25 22:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 37431d50-cf72-5885-afd9-523d39342c72 with identifier: 1977609 to the API
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '37431d50-cf72-5885-afd9-523d39342c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'E-NIRO',
 'odometer': 55590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA E-NIRO 64 kWh More',
 'transmission': 'automatic',
 'trim': '64 kWh More',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977609%27 HTTP/1.1" 200 None
2026-03-25 22:52:48 [ayvens.be] INFO: Saving data for 1977609: {'auction_closing_time': 1774600200.0, 'created_time': 1774306073.918109, 'last_price_update_time': 1774479168.347969}
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977609') HTTP/1.1" 204 0
2026-03-25 22:52:48 [ayvens.be] INFO: Found listing with ID: 1977610
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-25 22:52:48 [ayvens.be] INFO: Scrape type for 1977610: 2
2026-03-25 22:52:48 [ayvens.be] INFO: Extracting data for car ID: 1977610
2026-03-25 22:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-25 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba49b41-167c-5510-a7f6-344af3ca5feb with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dba49b41-167c-5510-a7f6-344af3ca5feb, identifier: 1977610
2026-03-25 22:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-25 22:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610
2026-03-25 22:52:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dba49b41-167c-5510-a7f6-344af3ca5feb with identifier: 1977610 to the API
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dba49b41-167c-5510-a7f6-344af3ca5feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 205744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D4 Momentum Pro Geartronic AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 D4 Momentum Pro Geartronic AdBlue',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977610%27 HTTP/1.1" 200 None
2026-03-25 22:52:48 [ayvens.be] INFO: Saving data for 1977610: {'auction_closing_time': 1774600200.0, 'created_time': 1774306075.481879, 'last_price_update_time': 1774479168.737112}
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977610') HTTP/1.1" 204 0
2026-03-25 22:52:48 [ayvens.be] INFO: Found listing with ID: 1977611
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-25 22:52:48 [ayvens.be] INFO: Scrape type for 1977611: 2
2026-03-25 22:52:48 [ayvens.be] INFO: Extracting data for car ID: 1977611
2026-03-25 22:52:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-25 22:52:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898dea59-cd2d-56de-8a0c-7be8a52134c9 with scrape type 2
2026-03-25 22:52:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 898dea59-cd2d-56de-8a0c-7be8a52134c9, identifier: 1977611
2026-03-25 22:52:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-25 22:52:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611
2026-03-25 22:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 898dea59-cd2d-56de-8a0c-7be8a52134c9 with identifier: 1977611 to the API
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '898dea59-cd2d-56de-8a0c-7be8a52134c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 135672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977611%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Saving data for 1977611: {'auction_closing_time': 1774600200.0, 'created_time': 1774306077.471025, 'last_price_update_time': 1774479169.193179}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977611') HTTP/1.1" 204 0
2026-03-25 22:52:49 [ayvens.be] INFO: Found listing with ID: 1977612
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Scrape type for 1977612: 2
2026-03-25 22:52:49 [ayvens.be] INFO: Extracting data for car ID: 1977612
2026-03-25 22:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-25 22:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-25 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0042e16-49d4-5186-91df-19abf8b1b381 with scrape type 2
2026-03-25 22:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0042e16-49d4-5186-91df-19abf8b1b381, identifier: 1977612
2026-03-25 22:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-25 22:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612
2026-03-25 22:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0042e16-49d4-5186-91df-19abf8b1b381 with identifier: 1977612 to the API
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a0042e16-49d4-5186-91df-19abf8b1b381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 61897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977612%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Saving data for 1977612: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.344922, 'last_price_update_time': 1774479169.571599}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977612') HTTP/1.1" 204 0
2026-03-25 22:52:49 [ayvens.be] INFO: Found listing with ID: 1977613
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Scrape type for 1977613: 2
2026-03-25 22:52:49 [ayvens.be] INFO: Extracting data for car ID: 1977613
2026-03-25 22:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-25 22:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-25 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660c9326-32a1-5c05-955c-dfcb85917614 with scrape type 2
2026-03-25 22:52:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 660c9326-32a1-5c05-955c-dfcb85917614, identifier: 1977613
2026-03-25 22:52:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-25 22:52:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613
2026-03-25 22:52:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 660c9326-32a1-5c05-955c-dfcb85917614 with identifier: 1977613 to the API
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '660c9326-32a1-5c05-955c-dfcb85917614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 107231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977613%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Saving data for 1977613: {'auction_closing_time': 1774600200.0, 'created_time': 1774306079.898043, 'last_price_update_time': 1774479169.934447}
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977613') HTTP/1.1" 204 0
2026-03-25 22:52:49 [ayvens.be] INFO: Found listing with ID: 1977614
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-25 22:52:49 [ayvens.be] INFO: Scrape type for 1977614: 2
2026-03-25 22:52:49 [ayvens.be] INFO: Extracting data for car ID: 1977614
2026-03-25 22:52:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-25 22:52:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-25 22:52:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7cf7938-333f-5878-9a82-a92f0466ca26 with scrape type 2
2026-03-25 22:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7cf7938-333f-5878-9a82-a92f0466ca26, identifier: 1977614
2026-03-25 22:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-25 22:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614
2026-03-25 22:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c7cf7938-333f-5878-9a82-a92f0466ca26 with identifier: 1977614 to the API
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c7cf7938-333f-5878-9a82-a92f0466ca26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 132687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977614%27 HTTP/1.1" 200 None
2026-03-25 22:52:50 [ayvens.be] INFO: Saving data for 1977614: {'auction_closing_time': 1774600200.0, 'created_time': 1774306082.02561, 'last_price_update_time': 1774479170.298332}
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977614') HTTP/1.1" 204 0
2026-03-25 22:52:50 [ayvens.be] INFO: Found listing with ID: 1977615
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-25 22:52:50 [ayvens.be] INFO: Scrape type for 1977615: 2
2026-03-25 22:52:50 [ayvens.be] INFO: Extracting data for car ID: 1977615
2026-03-25 22:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-25 22:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-25 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd0f094-d194-52c0-8bec-863643a930fd with scrape type 2
2026-03-25 22:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cd0f094-d194-52c0-8bec-863643a930fd, identifier: 1977615
2026-03-25 22:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-25 22:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615
2026-03-25 22:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cd0f094-d194-52c0-8bec-863643a930fd with identifier: 1977615 to the API
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cd0f094-d194-52c0-8bec-863643a930fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 145148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 180 d Business Solution',
 'transmission': 'automatic',
 'trim': 'A 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977615%27 HTTP/1.1" 200 None
2026-03-25 22:52:50 [ayvens.be] INFO: Saving data for 1977615: {'auction_closing_time': 1774600200.0, 'created_time': 1774306083.961453, 'last_price_update_time': 1774479170.665185}
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977615') HTTP/1.1" 204 0
2026-03-25 22:52:50 [ayvens.be] INFO: Found listing with ID: 1977616
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-25 22:52:50 [ayvens.be] INFO: Scrape type for 1977616: 2
2026-03-25 22:52:50 [ayvens.be] INFO: Extracting data for car ID: 1977616
2026-03-25 22:52:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-25 22:52:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-25 22:52:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff5db06-d1e9-56ee-834a-4d8989a81150 with scrape type 2
2026-03-25 22:52:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cff5db06-d1e9-56ee-834a-4d8989a81150, identifier: 1977616
2026-03-25 22:52:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-25 22:52:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616
2026-03-25 22:52:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cff5db06-d1e9-56ee-834a-4d8989a81150 with identifier: 1977616 to the API
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cff5db06-d1e9-56ee-834a-4d8989a81150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 131945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'transmission': 'automatic',
 'trim': '2.0 BIT 156KW 4WD D-CAB WILDTRAK AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977616%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Saving data for 1977616: {'auction_closing_time': 1774600200.0, 'created_time': 1774306085.891845, 'last_price_update_time': 1774479171.062205}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977616') HTTP/1.1" 204 0
2026-03-25 22:52:51 [ayvens.be] INFO: Found listing with ID: 1977617
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Scrape type for 1977617: 2
2026-03-25 22:52:51 [ayvens.be] INFO: Extracting data for car ID: 1977617
2026-03-25 22:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-25 22:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f4b029cf-ea7c-5649-ad7e-c5b21adfef70, identifier: 1977617
2026-03-25 22:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-25 22:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617
2026-03-25 22:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f4b029cf-ea7c-5649-ad7e-c5b21adfef70 with identifier: 1977617 to the API
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f4b029cf-ea7c-5649-ad7e-c5b21adfef70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 151650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977617%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Saving data for 1977617: {'auction_closing_time': 1774600200.0, 'created_time': 1774306086.945757, 'last_price_update_time': 1774479171.442679}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977617') HTTP/1.1" 204 0
2026-03-25 22:52:51 [ayvens.be] INFO: Found listing with ID: 1977618
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Scrape type for 1977618: 2
2026-03-25 22:52:51 [ayvens.be] INFO: Extracting data for car ID: 1977618
2026-03-25 22:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-25 22:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac, identifier: 1977618
2026-03-25 22:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-25 22:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618
2026-03-25 22:52:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 328e7d27-a6ce-5f45-b17c-b9a4da4041ac with identifier: 1977618 to the API
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '328e7d27-a6ce-5f45-b17c-b9a4da4041ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO DIESEL - 2018',
 'odometer': 101835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO DIESEL - 2018 1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.6 TDi SCR Comfortline (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977618%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Saving data for 1977618: {'auction_closing_time': 1774600200.0, 'created_time': 1774306088.303919, 'last_price_update_time': 1774479171.800602}
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977618') HTTP/1.1" 204 0
2026-03-25 22:52:51 [ayvens.be] INFO: Found listing with ID: 1977619
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-25 22:52:51 [ayvens.be] INFO: Scrape type for 1977619: 2
2026-03-25 22:52:51 [ayvens.be] INFO: Extracting data for car ID: 1977619
2026-03-25 22:52:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-25 22:52:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adeea2f-7916-56ea-a4b6-a301ec72b012 with scrape type 2
2026-03-25 22:52:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8adeea2f-7916-56ea-a4b6-a301ec72b012, identifier: 1977619
2026-03-25 22:52:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-25 22:52:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619
2026-03-25 22:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8adeea2f-7916-56ea-a4b6-a301ec72b012 with identifier: 1977619 to the API
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8adeea2f-7916-56ea-a4b6-a301ec72b012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 36989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977619%27 HTTP/1.1" 200 None
2026-03-25 22:52:52 [ayvens.be] INFO: Saving data for 1977619: {'auction_closing_time': 1774600200.0, 'created_time': 1774306089.702715, 'last_price_update_time': 1774479172.181613}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977619') HTTP/1.1" 204 0
2026-03-25 22:52:52 [ayvens.be] INFO: Found listing with ID: 1977620
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-25 22:52:52 [ayvens.be] INFO: Scrape type for 1977620: 2
2026-03-25 22:52:52 [ayvens.be] INFO: Extracting data for car ID: 1977620
2026-03-25 22:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-25 22:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-25 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e4ced7-c0d3-519f-83af-10ab6ba84912 with scrape type 2
2026-03-25 22:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4e4ced7-c0d3-519f-83af-10ab6ba84912, identifier: 1977620
2026-03-25 22:52:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-25 22:52:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620
2026-03-25 22:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4e4ced7-c0d3-519f-83af-10ab6ba84912 with identifier: 1977620 to the API
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b4e4ced7-c0d3-519f-83af-10ab6ba84912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 44894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC S LINE SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977620%27 HTTP/1.1" 200 None
2026-03-25 22:52:52 [ayvens.be] INFO: Saving data for 1977620: {'auction_closing_time': 1774600200.0, 'created_time': 1774306091.653171, 'last_price_update_time': 1774479172.559684}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977620') HTTP/1.1" 204 0
2026-03-25 22:52:52 [ayvens.be] INFO: Found listing with ID: 1977621
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-25 22:52:52 [ayvens.be] INFO: Scrape type for 1977621: 2
2026-03-25 22:52:52 [ayvens.be] INFO: Extracting data for car ID: 1977621
2026-03-25 22:52:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-25 22:52:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-25 22:52:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with scrape type 2
2026-03-25 22:52:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1c5d34e1-90e0-5364-948b-2d3368cc1c27, identifier: 1977621
2026-03-25 22:52:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-25 22:52:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621
2026-03-25 22:52:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1c5d34e1-90e0-5364-948b-2d3368cc1c27 with identifier: 1977621 to the API
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1c5d34e1-90e0-5364-948b-2d3368cc1c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 50647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE PACK',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977621%27 HTTP/1.1" 200 None
2026-03-25 22:52:52 [ayvens.be] INFO: Saving data for 1977621: {'auction_closing_time': 1774600200.0, 'created_time': 1774306092.658344, 'last_price_update_time': 1774479172.942842}
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977621') HTTP/1.1" 204 0
2026-03-25 22:52:53 [ayvens.be] INFO: Found listing with ID: 1977622
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-25 22:52:53 [ayvens.be] INFO: Scrape type for 1977622: 2
2026-03-25 22:52:53 [ayvens.be] INFO: Extracting data for car ID: 1977622
2026-03-25 22:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-25 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17482517-12b1-53dd-8638-ca59e46bd45c with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17482517-12b1-53dd-8638-ca59e46bd45c, identifier: 1977622
2026-03-25 22:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-25 22:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622
2026-03-25 22:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17482517-12b1-53dd-8638-ca59e46bd45c with identifier: 1977622 to the API
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '17482517-12b1-53dd-8638-ca59e46bd45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977622%27 HTTP/1.1" 200 None
2026-03-25 22:52:53 [ayvens.be] INFO: Saving data for 1977622: {'auction_closing_time': 1774600200.0, 'created_time': 1774306095.365105, 'last_price_update_time': 1774479173.408169}
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977622') HTTP/1.1" 204 0
2026-03-25 22:52:53 [ayvens.be] INFO: Found listing with ID: 1977623
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-25 22:52:53 [ayvens.be] INFO: Scrape type for 1977623: 2
2026-03-25 22:52:53 [ayvens.be] INFO: Extracting data for car ID: 1977623
2026-03-25 22:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-25 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395845a7-e6de-568b-922f-6834cd836242 with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 395845a7-e6de-568b-922f-6834cd836242, identifier: 1977623
2026-03-25 22:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-25 22:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623
2026-03-25 22:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 395845a7-e6de-568b-922f-6834cd836242 with identifier: 1977623 to the API
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '395845a7-e6de-568b-922f-6834cd836242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 159350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977623%27 HTTP/1.1" 200 None
2026-03-25 22:52:53 [ayvens.be] INFO: Saving data for 1977623: {'auction_closing_time': 1774600200.0, 'created_time': 1774306096.610145, 'last_price_update_time': 1774479173.7875}
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977623') HTTP/1.1" 204 0
2026-03-25 22:52:53 [ayvens.be] INFO: Found listing with ID: 1977624
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-25 22:52:53 [ayvens.be] INFO: Scrape type for 1977624: 2
2026-03-25 22:52:53 [ayvens.be] INFO: Extracting data for car ID: 1977624
2026-03-25 22:52:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-25 22:52:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9098dd5f-54ad-563a-b02b-c3e0efe05603 with scrape type 2
2026-03-25 22:52:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9098dd5f-54ad-563a-b02b-c3e0efe05603, identifier: 1977624
2026-03-25 22:52:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-25 22:52:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624
2026-03-25 22:52:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9098dd5f-54ad-563a-b02b-c3e0efe05603 with identifier: 1977624 to the API
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9098dd5f-54ad-563a-b02b-c3e0efe05603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 35503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA 1.0 IG-T ACENTA',
 'transmission': 'manual',
 'trim': '1.0 IG-T ACENTA',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977624%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Saving data for 1977624: {'auction_closing_time': 1774600200.0, 'created_time': 1774306098.176585, 'last_price_update_time': 1774479174.163562}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977624') HTTP/1.1" 204 0
2026-03-25 22:52:54 [ayvens.be] INFO: Found listing with ID: 1977625
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Scrape type for 1977625: 2
2026-03-25 22:52:54 [ayvens.be] INFO: Extracting data for car ID: 1977625
2026-03-25 22:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-25 22:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-25 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cae6efa-1e19-5809-96ef-b55cab49d096 with scrape type 2
2026-03-25 22:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cae6efa-1e19-5809-96ef-b55cab49d096, identifier: 1977625
2026-03-25 22:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-25 22:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625
2026-03-25 22:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0cae6efa-1e19-5809-96ef-b55cab49d096 with identifier: 1977625 to the API
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0cae6efa-1e19-5809-96ef-b55cab49d096',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER 300 FOU LWB DSL - 201',
 'odometer': 97532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 300 FOU LWB DSL - 201 314 2.1 CDI L3H2 RWD '
          'Functional',
 'transmission': 'manual',
 'trim': '314 2.1 CDI L3H2 RWD Functional',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977625%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Saving data for 1977625: {'auction_closing_time': 1774600200.0, 'created_time': 1774306099.785612, 'last_price_update_time': 1774479174.534166}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977625') HTTP/1.1" 204 0
2026-03-25 22:52:54 [ayvens.be] INFO: Found listing with ID: 1977626
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Scrape type for 1977626: 2
2026-03-25 22:52:54 [ayvens.be] INFO: Extracting data for car ID: 1977626
2026-03-25 22:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-25 22:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-25 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4571c8eb-bd65-57af-a509-c1147d519ef0 with scrape type 2
2026-03-25 22:52:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4571c8eb-bd65-57af-a509-c1147d519ef0, identifier: 1977626
2026-03-25 22:52:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-25 22:52:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626
2026-03-25 22:52:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4571c8eb-bd65-57af-a509-c1147d519ef0 with identifier: 1977626 to the API
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4571c8eb-bd65-57af-a509-c1147d519ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D",
 'odometer': 52057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977626%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Saving data for 1977626: {'auction_closing_time': 1774600200.0, 'created_time': 1774306101.028811, 'last_price_update_time': 1774479174.935285}
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977626') HTTP/1.1" 204 0
2026-03-25 22:52:54 [ayvens.be] INFO: Found listing with ID: 1977627
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-25 22:52:54 [ayvens.be] INFO: Scrape type for 1977627: 2
2026-03-25 22:52:54 [ayvens.be] INFO: Extracting data for car ID: 1977627
2026-03-25 22:52:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-25 22:52:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-25 22:52:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d43feb-66a5-5782-affb-8345854bfbde with scrape type 2
2026-03-25 22:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62d43feb-66a5-5782-affb-8345854bfbde, identifier: 1977627
2026-03-25 22:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-25 22:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627
2026-03-25 22:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 62d43feb-66a5-5782-affb-8345854bfbde with identifier: 1977627 to the API
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '62d43feb-66a5-5782-affb-8345854bfbde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 64632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977627%27 HTTP/1.1" 200 None
2026-03-25 22:52:55 [ayvens.be] INFO: Saving data for 1977627: {'auction_closing_time': 1774600200.0, 'created_time': 1774306103.643748, 'last_price_update_time': 1774479175.305618}
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977627') HTTP/1.1" 204 0
2026-03-25 22:52:55 [ayvens.be] INFO: Found listing with ID: 1977628
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-25 22:52:55 [ayvens.be] INFO: Scrape type for 1977628: 2
2026-03-25 22:52:55 [ayvens.be] INFO: Extracting data for car ID: 1977628
2026-03-25 22:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-25 22:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-25 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with scrape type 2
2026-03-25 22:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70, identifier: 1977628
2026-03-25 22:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-25 22:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628
2026-03-25 22:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c2c941d7-d350-5adb-8ad0-3b8b1dda6c70 with identifier: 1977628 to the API
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c2c941d7-d350-5adb-8ad0-3b8b1dda6c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 59595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '1.5 TSI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977628%27 HTTP/1.1" 200 None
2026-03-25 22:52:55 [ayvens.be] INFO: Saving data for 1977628: {'auction_closing_time': 1774600200.0, 'created_time': 1774306104.818584, 'last_price_update_time': 1774479175.671591}
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977628') HTTP/1.1" 204 0
2026-03-25 22:52:55 [ayvens.be] INFO: Found listing with ID: 1977629
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-25 22:52:55 [ayvens.be] INFO: Scrape type for 1977629: 2
2026-03-25 22:52:55 [ayvens.be] INFO: Extracting data for car ID: 1977629
2026-03-25 22:52:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-25 22:52:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-25 22:52:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04681dfe-2f8c-578e-8116-eed572210b54 with scrape type 2
2026-03-25 22:52:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 04681dfe-2f8c-578e-8116-eed572210b54, identifier: 1977629
2026-03-25 22:52:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-25 22:52:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629
2026-03-25 22:52:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 04681dfe-2f8c-578e-8116-eed572210b54 with identifier: 1977629 to the API
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '04681dfe-2f8c-578e-8116-eed572210b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 49804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 1.3 B 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 B 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977629%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Saving data for 1977629: {'auction_closing_time': 1774600200.0, 'created_time': 1774306106.15014, 'last_price_update_time': 1774479176.036509}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977629') HTTP/1.1" 204 0
2026-03-25 22:52:56 [ayvens.be] INFO: Found listing with ID: 1977630
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Scrape type for 1977630: 2
2026-03-25 22:52:56 [ayvens.be] INFO: Extracting data for car ID: 1977630
2026-03-25 22:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-25 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-25 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with scrape type 2
2026-03-25 22:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b, identifier: 1977630
2026-03-25 22:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-25 22:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630
2026-03-25 22:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91e98abb-e4ba-5a6c-a670-45271e3f4d8b with identifier: 1977630 to the API
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '91e98abb-e4ba-5a6c-a670-45271e3f4d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'IVECO',
 'model': 'DAILY',
 'odometer': 164400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'IVECO DAILY IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'transmission': 'manual',
 'trim': 'IVECO Daily 50C18H V-P-3.0 Turbo (4100)',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977630%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Saving data for 1977630: {'auction_closing_time': 1774600200.0, 'created_time': 1774306107.42825, 'last_price_update_time': 1774479176.409294}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977630') HTTP/1.1" 204 0
2026-03-25 22:52:56 [ayvens.be] INFO: Found listing with ID: 1977631
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Scrape type for 1977631: 2
2026-03-25 22:52:56 [ayvens.be] INFO: Extracting data for car ID: 1977631
2026-03-25 22:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-25 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-25 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe5789cb-bdae-502d-981e-e67eb4c6ad8f with scrape type 2
2026-03-25 22:52:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe5789cb-bdae-502d-981e-e67eb4c6ad8f, identifier: 1977631
2026-03-25 22:52:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-25 22:52:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631
2026-03-25 22:52:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe5789cb-bdae-502d-981e-e67eb4c6ad8f with identifier: 1977631 to the API
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fe5789cb-bdae-502d-981e-e67eb4c6ad8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 105463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM PRO',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM PRO',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977631%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Saving data for 1977631: {'auction_closing_time': 1774600200.0, 'created_time': 1774306109.425923, 'last_price_update_time': 1774479176.913933}
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977631') HTTP/1.1" 204 0
2026-03-25 22:52:56 [ayvens.be] INFO: Found listing with ID: 1977632
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-25 22:52:56 [ayvens.be] INFO: Scrape type for 1977632: 2
2026-03-25 22:52:56 [ayvens.be] INFO: Extracting data for car ID: 1977632
2026-03-25 22:52:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-25 22:52:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-25 22:52:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db717a7-54d5-52a2-9622-9c38b840ce30 with scrape type 2
2026-03-25 22:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3db717a7-54d5-52a2-9622-9c38b840ce30, identifier: 1977632
2026-03-25 22:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-25 22:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632
2026-03-25 22:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3db717a7-54d5-52a2-9622-9c38b840ce30 with identifier: 1977632 to the API
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3db717a7-54d5-52a2-9622-9c38b840ce30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 78533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977632%27 HTTP/1.1" 200 None
2026-03-25 22:52:57 [ayvens.be] INFO: Saving data for 1977632: {'auction_closing_time': 1774600200.0, 'created_time': 1774306111.757229, 'last_price_update_time': 1774479177.302874}
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977632') HTTP/1.1" 204 0
2026-03-25 22:52:57 [ayvens.be] INFO: Found listing with ID: 1977633
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-25 22:52:57 [ayvens.be] INFO: Scrape type for 1977633: 2
2026-03-25 22:52:57 [ayvens.be] INFO: Extracting data for car ID: 1977633
2026-03-25 22:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-25 22:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-25 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1be1016-d29e-54f5-bd1a-d0214c12115e with scrape type 2
2026-03-25 22:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a1be1016-d29e-54f5-bd1a-d0214c12115e, identifier: 1977633
2026-03-25 22:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-25 22:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633
2026-03-25 22:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a1be1016-d29e-54f5-bd1a-d0214c12115e with identifier: 1977633 to the API
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a1be1016-d29e-54f5-bd1a-d0214c12115e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 75629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 96KW S&S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977633%27 HTTP/1.1" 200 None
2026-03-25 22:52:57 [ayvens.be] INFO: Saving data for 1977633: {'auction_closing_time': 1774600200.0, 'created_time': 1774306112.985921, 'last_price_update_time': 1774479177.765685}
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977633') HTTP/1.1" 204 0
2026-03-25 22:52:57 [ayvens.be] INFO: Found listing with ID: 1977634
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-25 22:52:57 [ayvens.be] INFO: Scrape type for 1977634: 2
2026-03-25 22:52:57 [ayvens.be] INFO: Extracting data for car ID: 1977634
2026-03-25 22:52:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-25 22:52:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-25 22:52:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18014459-f58b-5111-9c13-67b4c82529c1 with scrape type 2
2026-03-25 22:52:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18014459-f58b-5111-9c13-67b4c82529c1, identifier: 1977634
2026-03-25 22:52:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-25 22:52:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634
2026-03-25 22:52:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 18014459-f58b-5111-9c13-67b4c82529c1 with identifier: 1977634 to the API
2026-03-25 22:52:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '18014459-f58b-5111-9c13-67b4c82529c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MUSTANG MACH-E',
 'odometer': 131896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MUSTANG MACH-E BEV 99KWH 216KW EXTENDED RANGE RWD',
 'transmission': 'automatic',
 'trim': 'BEV 99KWH 216KW EXTENDED RANGE RWD',
 'vin': None,
 'year': 2022}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977634%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Saving data for 1977634: {'auction_closing_time': 1774600200.0, 'created_time': 1774306114.134582, 'last_price_update_time': 1774479178.169707}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977634') HTTP/1.1" 204 0
2026-03-25 22:52:58 [ayvens.be] INFO: Found listing with ID: 1977635
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Scrape type for 1977635: 2
2026-03-25 22:52:58 [ayvens.be] INFO: Extracting data for car ID: 1977635
2026-03-25 22:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-25 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-25 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71985439-3ef0-5027-9dad-d60a2915edf4 with scrape type 2
2026-03-25 22:52:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71985439-3ef0-5027-9dad-d60a2915edf4, identifier: 1977635
2026-03-25 22:52:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-25 22:52:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635
2026-03-25 22:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71985439-3ef0-5027-9dad-d60a2915edf4 with identifier: 1977635 to the API
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '71985439-3ef0-5027-9dad-d60a2915edf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 DIESEL - 2018',
 'odometer': 191014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 DIESEL - 2018 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977635%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Saving data for 1977635: {'auction_closing_time': 1774600200.0, 'created_time': 1774306116.570474, 'last_price_update_time': 1774479178.559077}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977635') HTTP/1.1" 204 0
2026-03-25 22:52:58 [ayvens.be] INFO: Found listing with ID: 1977636
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Scrape type for 1977636: 2
2026-03-25 22:52:58 [ayvens.be] INFO: Extracting data for car ID: 1977636
2026-03-25 22:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-25 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-25 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with scrape type 2
2026-03-25 22:52:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1, identifier: 1977636
2026-03-25 22:52:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-25 22:52:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636
2026-03-25 22:52:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0e5fb78d-d2d1-5307-ae51-85f87434b7c1 with identifier: 1977636 to the API
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0e5fb78d-d2d1-5307-ae51-85f87434b7c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 49405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977636%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Saving data for 1977636: {'auction_closing_time': 1774600200.0, 'created_time': 1774306117.805193, 'last_price_update_time': 1774479178.93268}
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977636') HTTP/1.1" 204 0
2026-03-25 22:52:58 [ayvens.be] INFO: Found listing with ID: 1977637
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-25 22:52:58 [ayvens.be] INFO: Scrape type for 1977637: 2
2026-03-25 22:52:58 [ayvens.be] INFO: Extracting data for car ID: 1977637
2026-03-25 22:52:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-25 22:52:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-25 22:52:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c9a9fb-7084-50f0-a4e6-835fba729daa with scrape type 2
2026-03-25 22:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33c9a9fb-7084-50f0-a4e6-835fba729daa, identifier: 1977637
2026-03-25 22:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-25 22:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637
2026-03-25 22:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 33c9a9fb-7084-50f0-a4e6-835fba729daa with identifier: 1977637 to the API
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '33c9a9fb-7084-50f0-a4e6-835fba729daa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 DIESEL - 2019',
 'odometer': 161246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 DIESEL - 2019 320 d AdBlue',
 'transmission': 'manual',
 'trim': '320 d AdBlue',
 'vin': None,
 'year': 2019}
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977637%27 HTTP/1.1" 200 None
2026-03-25 22:52:59 [ayvens.be] INFO: Saving data for 1977637: {'auction_closing_time': 1774600200.0, 'created_time': 1774306120.415893, 'last_price_update_time': 1774479179.293681}
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977637') HTTP/1.1" 204 0
2026-03-25 22:52:59 [ayvens.be] INFO: Found listing with ID: 1977638
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-25 22:52:59 [ayvens.be] INFO: Scrape type for 1977638: 2
2026-03-25 22:52:59 [ayvens.be] INFO: Extracting data for car ID: 1977638
2026-03-25 22:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-25 22:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-25 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc1ac4d-b143-5693-b563-12d0a0856b05 with scrape type 2
2026-03-25 22:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bc1ac4d-b143-5693-b563-12d0a0856b05, identifier: 1977638
2026-03-25 22:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-25 22:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638
2026-03-25 22:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bc1ac4d-b143-5693-b563-12d0a0856b05 with identifier: 1977638 to the API
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:52:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'electric',
 'id': '2bc1ac4d-b143-5693-b563-12d0a0856b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 118853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977638%27 HTTP/1.1" 200 None
2026-03-25 22:52:59 [ayvens.be] INFO: Saving data for 1977638: {'auction_closing_time': 1774600200.0, 'created_time': 1774306122.016568, 'last_price_update_time': 1774479179.662278}
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977638') HTTP/1.1" 204 0
2026-03-25 22:52:59 [ayvens.be] INFO: Found listing with ID: 1977639
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-25 22:52:59 [ayvens.be] INFO: Scrape type for 1977639: 2
2026-03-25 22:52:59 [ayvens.be] INFO: Extracting data for car ID: 1977639
2026-03-25 22:52:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-25 22:52:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-25 22:52:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with scrape type 2
2026-03-25 22:52:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3, identifier: 1977639
2026-03-25 22:52:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-25 22:52:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639
2026-03-25 22:52:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3 with identifier: 1977639 to the API
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:52:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dc5cdb25-68db-5ba3-961f-cd9e53bc0ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 164501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 1.5 TGI TRENDLINE DSG',
 'transmission': 'automatic',
 'trim': '1.5 TGI TRENDLINE DSG',
 'vin': None,
 'year': 2019}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977639%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Saving data for 1977639: {'auction_closing_time': 1774600200.0, 'created_time': 1774306123.612035, 'last_price_update_time': 1774479180.025137}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977639') HTTP/1.1" 204 0
2026-03-25 22:53:00 [ayvens.be] INFO: Found listing with ID: 1977640
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Scrape type for 1977640: 2
2026-03-25 22:53:00 [ayvens.be] INFO: Extracting data for car ID: 1977640
2026-03-25 22:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-25 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c610f8e2-beb2-57b7-a175-40a50bb05d37 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c610f8e2-beb2-57b7-a175-40a50bb05d37, identifier: 1977640
2026-03-25 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-25 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640
2026-03-25 22:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c610f8e2-beb2-57b7-a175-40a50bb05d37 with identifier: 1977640 to the API
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c610f8e2-beb2-57b7-a175-40a50bb05d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 113575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977640%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Saving data for 1977640: {'auction_closing_time': 1774600200.0, 'created_time': 1774306125.152589, 'last_price_update_time': 1774479180.424749}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977640') HTTP/1.1" 204 0
2026-03-25 22:53:00 [ayvens.be] INFO: Found listing with ID: 1977641
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Scrape type for 1977641: 2
2026-03-25 22:53:00 [ayvens.be] INFO: Extracting data for car ID: 1977641
2026-03-25 22:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-25 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03aecc3-08a0-538e-8586-940b044c7f49 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b03aecc3-08a0-538e-8586-940b044c7f49, identifier: 1977641
2026-03-25 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-25 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641
2026-03-25 22:53:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b03aecc3-08a0-538e-8586-940b044c7f49 with identifier: 1977641 to the API
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b03aecc3-08a0-538e-8586-940b044c7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 43010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 80 GRAND CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 80 GRAND CONFORT',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977641%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Saving data for 1977641: {'auction_closing_time': 1774600200.0, 'created_time': 1774306127.212522, 'last_price_update_time': 1774479180.800424}
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977641') HTTP/1.1" 204 0
2026-03-25 22:53:00 [ayvens.be] INFO: Found listing with ID: 1977642
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-25 22:53:00 [ayvens.be] INFO: Scrape type for 1977642: 2
2026-03-25 22:53:00 [ayvens.be] INFO: Extracting data for car ID: 1977642
2026-03-25 22:53:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-25 22:53:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6eb3d18-d773-5789-bae6-90b5a76843b4 with scrape type 2
2026-03-25 22:53:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6eb3d18-d773-5789-bae6-90b5a76843b4, identifier: 1977642
2026-03-25 22:53:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-25 22:53:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642
2026-03-25 22:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6eb3d18-d773-5789-bae6-90b5a76843b4 with identifier: 1977642 to the API
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e6eb3d18-d773-5789-bae6-90b5a76843b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 76532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977642%27 HTTP/1.1" 200 None
2026-03-25 22:53:01 [ayvens.be] INFO: Saving data for 1977642: {'auction_closing_time': 1774600200.0, 'created_time': 1774306128.101279, 'last_price_update_time': 1774479181.178334}
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977642') HTTP/1.1" 204 0
2026-03-25 22:53:01 [ayvens.be] INFO: Found listing with ID: 1977643
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-25 22:53:01 [ayvens.be] INFO: Scrape type for 1977643: 2
2026-03-25 22:53:01 [ayvens.be] INFO: Extracting data for car ID: 1977643
2026-03-25 22:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-25 22:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-25 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with scrape type 2
2026-03-25 22:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6, identifier: 1977643
2026-03-25 22:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-25 22:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643
2026-03-25 22:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0fd093f2-9a35-53a6-be04-9222e5ec0ff6 with identifier: 1977643 to the API
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0fd093f2-9a35-53a6-be04-9222e5ec0ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 64402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI S TRONIC BUS. ED. ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977643%27 HTTP/1.1" 200 None
2026-03-25 22:53:01 [ayvens.be] INFO: Saving data for 1977643: {'auction_closing_time': 1774600200.0, 'created_time': 1774306129.637529, 'last_price_update_time': 1774479181.54071}
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977643') HTTP/1.1" 204 0
2026-03-25 22:53:01 [ayvens.be] INFO: Found listing with ID: 1977644
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-25 22:53:01 [ayvens.be] INFO: Scrape type for 1977644: 2
2026-03-25 22:53:01 [ayvens.be] INFO: Extracting data for car ID: 1977644
2026-03-25 22:53:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-25 22:53:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-25 22:53:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with scrape type 2
2026-03-25 22:53:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd, identifier: 1977644
2026-03-25 22:53:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-25 22:53:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644
2026-03-25 22:53:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 914b0f3b-2e2f-5dad-bb98-58fa8eea90bd with identifier: 1977644 to the API
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '914b0f3b-2e2f-5dad-bb98-58fa8eea90bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 62021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.0 TSI MHEV 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI MHEV 81KW DSG CLEVER+',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977644%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Saving data for 1977644: {'auction_closing_time': 1774600200.0, 'created_time': 1774306131.140362, 'last_price_update_time': 1774479182.011864}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977644') HTTP/1.1" 204 0
2026-03-25 22:53:02 [ayvens.be] INFO: Found listing with ID: 1977645
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Scrape type for 1977645: 2
2026-03-25 22:53:02 [ayvens.be] INFO: Extracting data for car ID: 1977645
2026-03-25 22:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-25 22:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 814d2c36-6229-5ab3-b05a-23a12b4c94ff with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 814d2c36-6229-5ab3-b05a-23a12b4c94ff, identifier: 1977645
2026-03-25 22:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-25 22:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645
2026-03-25 22:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 814d2c36-6229-5ab3-b05a-23a12b4c94ff with identifier: 1977645 to the API
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '814d2c36-6229-5ab3-b05a-23a12b4c94ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 89692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977645%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Saving data for 1977645: {'auction_closing_time': 1774600200.0, 'created_time': 1774306132.78185, 'last_price_update_time': 1774479182.380808}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977645') HTTP/1.1" 204 0
2026-03-25 22:53:02 [ayvens.be] INFO: Found listing with ID: 1977646
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Scrape type for 1977646: 2
2026-03-25 22:53:02 [ayvens.be] INFO: Extracting data for car ID: 1977646
2026-03-25 22:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-25 22:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1569a679-9137-588f-9b01-c3bb9afa5b34 with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1569a679-9137-588f-9b01-c3bb9afa5b34, identifier: 1977646
2026-03-25 22:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-25 22:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646
2026-03-25 22:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1569a679-9137-588f-9b01-c3bb9afa5b34 with identifier: 1977646 to the API
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1569a679-9137-588f-9b01-c3bb9afa5b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 58869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2019}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977646%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Saving data for 1977646: {'auction_closing_time': 1774600200.0, 'created_time': 1774306134.614206, 'last_price_update_time': 1774479182.757051}
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977646') HTTP/1.1" 204 0
2026-03-25 22:53:02 [ayvens.be] INFO: Found listing with ID: 1977647
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-25 22:53:02 [ayvens.be] INFO: Scrape type for 1977647: 2
2026-03-25 22:53:02 [ayvens.be] INFO: Extracting data for car ID: 1977647
2026-03-25 22:53:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-25 22:53:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with scrape type 2
2026-03-25 22:53:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6205baa6-9762-57bd-b12c-8ce1b3efbec2, identifier: 1977647
2026-03-25 22:53:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-25 22:53:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647
2026-03-25 22:53:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6205baa6-9762-57bd-b12c-8ce1b3efbec2 with identifier: 1977647 to the API
2026-03-25 22:53:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6205baa6-9762-57bd-b12c-8ce1b3efbec2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 50A FOURGON LWB HR DSL',
 'odometer': 137528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 50A FOURGON LWB HR DSL 2.0 TDI',
 'transmission': 'automatic',
 'trim': '2.0 TDI',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977647%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Saving data for 1977647: {'auction_closing_time': 1774600200.0, 'created_time': 1774306136.152125, 'last_price_update_time': 1774479183.128803}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977647') HTTP/1.1" 204 0
2026-03-25 22:53:03 [ayvens.be] INFO: Found listing with ID: 1977648
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Scrape type for 1977648: 2
2026-03-25 22:53:03 [ayvens.be] INFO: Extracting data for car ID: 1977648
2026-03-25 22:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-25 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-25 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2401b826-b801-509d-8e4b-bbef750b2607 with scrape type 2
2026-03-25 22:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2401b826-b801-509d-8e4b-bbef750b2607, identifier: 1977648
2026-03-25 22:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-25 22:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648
2026-03-25 22:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2401b826-b801-509d-8e4b-bbef750b2607 with identifier: 1977648 to the API
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2401b826-b801-509d-8e4b-bbef750b2607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER 35 FOURGON MWB HR DSL',
 'odometer': 238611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 FOURGON MWB HR DSL 2.0 CR TDi L3H3 4Motion '
          'Automatic-8',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi L3H3 4Motion Automatic-8',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977648%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Saving data for 1977648: {'auction_closing_time': 1774600200.0, 'created_time': 1774306137.615192, 'last_price_update_time': 1774479183.491912}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977648') HTTP/1.1" 204 0
2026-03-25 22:53:03 [ayvens.be] INFO: Found listing with ID: 1977649
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Scrape type for 1977649: 2
2026-03-25 22:53:03 [ayvens.be] INFO: Extracting data for car ID: 1977649
2026-03-25 22:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-25 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-25 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with scrape type 2
2026-03-25 22:53:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37, identifier: 1977649
2026-03-25 22:53:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-25 22:53:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649
2026-03-25 22:53:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37 with identifier: 1977649 to the API
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b0d5eedb-6a3c-5a54-9ef0-8a5769f54e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 170952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977649%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Saving data for 1977649: {'auction_closing_time': 1774600200.0, 'created_time': 1774306140.052591, 'last_price_update_time': 1774479183.887266}
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977649') HTTP/1.1" 204 0
2026-03-25 22:53:03 [ayvens.be] INFO: Found listing with ID: 1977650
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-25 22:53:03 [ayvens.be] INFO: Scrape type for 1977650: 2
2026-03-25 22:53:03 [ayvens.be] INFO: Extracting data for car ID: 1977650
2026-03-25 22:53:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-25 22:53:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-25 22:53:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with scrape type 2
2026-03-25 22:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519, identifier: 1977650
2026-03-25 22:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-25 22:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650
2026-03-25 22:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519 with identifier: 1977650 to the API
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ab1fe6c5-66ec-5a2f-bc3a-5a14b01ab519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 84901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 180 AMG LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 180 AMG LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977650%27 HTTP/1.1" 200 None
2026-03-25 22:53:04 [ayvens.be] INFO: Saving data for 1977650: {'auction_closing_time': 1774600200.0, 'created_time': 1774306142.548573, 'last_price_update_time': 1774479184.253011}
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977650') HTTP/1.1" 204 0
2026-03-25 22:53:04 [ayvens.be] INFO: Found listing with ID: 1977651
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-25 22:53:04 [ayvens.be] INFO: Scrape type for 1977651: 2
2026-03-25 22:53:04 [ayvens.be] INFO: Extracting data for car ID: 1977651
2026-03-25 22:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-25 22:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-25 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4371569f-bc3c-5de1-936c-0c8550d1ac98 with scrape type 2
2026-03-25 22:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4371569f-bc3c-5de1-936c-0c8550d1ac98, identifier: 1977651
2026-03-25 22:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-25 22:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651
2026-03-25 22:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4371569f-bc3c-5de1-936c-0c8550d1ac98 with identifier: 1977651 to the API
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4371569f-bc3c-5de1-936c-0c8550d1ac98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 92220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977651%27 HTTP/1.1" 200 None
2026-03-25 22:53:04 [ayvens.be] INFO: Saving data for 1977651: {'auction_closing_time': 1774600200.0, 'created_time': 1774306143.447302, 'last_price_update_time': 1774479184.621096}
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977651') HTTP/1.1" 204 0
2026-03-25 22:53:04 [ayvens.be] INFO: Found listing with ID: 1977652
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-25 22:53:04 [ayvens.be] INFO: Scrape type for 1977652: 2
2026-03-25 22:53:04 [ayvens.be] INFO: Extracting data for car ID: 1977652
2026-03-25 22:53:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-25 22:53:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-25 22:53:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eb65bea-c7a6-59ea-821b-c1f675131729 with scrape type 2
2026-03-25 22:53:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5eb65bea-c7a6-59ea-821b-c1f675131729, identifier: 1977652
2026-03-25 22:53:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-25 22:53:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652
2026-03-25 22:53:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5eb65bea-c7a6-59ea-821b-c1f675131729 with identifier: 1977652 to the API
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5eb65bea-c7a6-59ea-821b-c1f675131729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.5  A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977652%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Saving data for 1977652: {'auction_closing_time': 1774600200.0, 'created_time': 1774306145.64127, 'last_price_update_time': 1774479185.017424}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977652') HTTP/1.1" 204 0
2026-03-25 22:53:05 [ayvens.be] INFO: Found listing with ID: 1977653
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Scrape type for 1977653: 2
2026-03-25 22:53:05 [ayvens.be] INFO: Extracting data for car ID: 1977653
2026-03-25 22:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-25 22:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71f81a0e-a421-5d81-a66c-c31ca3add5c4, identifier: 1977653
2026-03-25 22:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-25 22:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653
2026-03-25 22:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71f81a0e-a421-5d81-a66c-c31ca3add5c4 with identifier: 1977653 to the API
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '71f81a0e-a421-5d81-a66c-c31ca3add5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 97378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 INSCRIPTION AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 INSCRIPTION AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977653%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Saving data for 1977653: {'auction_closing_time': 1774600200.0, 'created_time': 1774306146.908984, 'last_price_update_time': 1774479185.390848}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977653') HTTP/1.1" 204 0
2026-03-25 22:53:05 [ayvens.be] INFO: Found listing with ID: 1977654
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Scrape type for 1977654: 2
2026-03-25 22:53:05 [ayvens.be] INFO: Extracting data for car ID: 1977654
2026-03-25 22:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-25 22:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d73573a-a368-5a86-899a-67b284d5eac9 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3d73573a-a368-5a86-899a-67b284d5eac9, identifier: 1977654
2026-03-25 22:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-25 22:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654
2026-03-25 22:53:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3d73573a-a368-5a86-899a-67b284d5eac9 with identifier: 1977654 to the API
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3d73573a-a368-5a86-899a-67b284d5eac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 53660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977654%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Saving data for 1977654: {'auction_closing_time': 1774600200.0, 'created_time': 1774306148.67269, 'last_price_update_time': 1774479185.779124}
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977654') HTTP/1.1" 204 0
2026-03-25 22:53:05 [ayvens.be] INFO: Found listing with ID: 1977655
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-25 22:53:05 [ayvens.be] INFO: Scrape type for 1977655: 2
2026-03-25 22:53:05 [ayvens.be] INFO: Extracting data for car ID: 1977655
2026-03-25 22:53:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-25 22:53:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda391cb-dd87-5c47-bb85-a53130a04133 with scrape type 2
2026-03-25 22:53:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda391cb-dd87-5c47-bb85-a53130a04133, identifier: 1977655
2026-03-25 22:53:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-25 22:53:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655
2026-03-25 22:53:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda391cb-dd87-5c47-bb85-a53130a04133 with identifier: 1977655 to the API
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda391cb-dd87-5c47-bb85-a53130a04133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40924',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 104044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE18IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE18IA (100KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977655%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Saving data for 1977655: {'auction_closing_time': 1774600200.0, 'created_time': 1774306150.08875, 'last_price_update_time': 1774479186.25092}
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1977655') HTTP/1.1" 204 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977656
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977656%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977656: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977657
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977657%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977657: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977658
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977658%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977658: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977659
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977659%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977659: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977660
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977660%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977660: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977661
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977661%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977661: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977662
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977662%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977662: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977663
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977663%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977663: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977664
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977664%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977664: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977665
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977665%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977665: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977666
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977666%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977666: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977667
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977667%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977667: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977668
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977668%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977668: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977669
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977669%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977669: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977670
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977670%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977670: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977671
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977671%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977671: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977672
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977672%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977672: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977673
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977673%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977673: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977674
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977674%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977674: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977675
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977675%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977675: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977676
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977676%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977676: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977677
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977677%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977677: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977678
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977678%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977678: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977679
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977679%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977679: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Found listing with ID: 1977680
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977680%27 HTTP/1.1" 200 None
2026-03-25 22:53:06 [ayvens.be] INFO: Scrape type for 1977680: 0
2026-03-25 22:53:06 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-25 22:53:06 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 1 pages/min), scraped 444 items (at 138 items/min)
2026-03-25 22:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:53:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977681
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977681%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977681: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977682
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977682%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977682: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977683
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977683%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977683: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977684
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977684%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977684: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977685
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977685%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977685: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977686
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977686%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977686: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977687
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977687%27 HTTP/1.1" 200 None
2026-03-25 22:53:08 [ayvens.be] INFO: Scrape type for 1977687: 0
2026-03-25 22:53:08 [ayvens.be] INFO: Found listing with ID: 1977688
2026-03-25 22:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977688%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977688: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977689
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977689%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977689: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977690
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977690%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977690: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977691
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977691%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977691: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977692
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977692%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977692: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977693
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977693%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977693: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977694
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977694%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977694: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977695
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977695%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977695: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977696
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977696%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977696: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977697
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977697%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977697: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977698
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977698%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977698: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977699
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977699%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977699: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977700
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977700%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977700: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977701
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977701%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977701: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977702
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977702%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977702: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977703
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977703%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977703: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977704
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977704%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977704: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977705
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977705%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977705: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977706
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977706%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977706: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977707
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977707%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977707: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977708
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977708%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977708: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977709
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977709%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977709: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977710
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977710%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977710: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977711
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977711%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977711: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977712
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977712%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977712: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1977713
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271977713%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1977713: 0
2026-03-25 22:53:09 [ayvens.be] INFO: Found listing with ID: 1980237
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980237%27 HTTP/1.1" 200 None
2026-03-25 22:53:09 [ayvens.be] INFO: Scrape type for 1980237: 2
2026-03-25 22:53:09 [ayvens.be] INFO: Extracting data for car ID: 1980237
2026-03-25 22:53:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-25 22:53:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 2
2026-03-25 22:53:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with scrape type 2
2026-03-25 22:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9, identifier: 1980237
2026-03-25 22:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-25 22:53:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237
2026-03-25 22:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cedfca8f-75b5-5fc8-8992-8c4e6b512ab9 with identifier: 1980237 to the API
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cedfca8f-75b5-5fc8-8992-8c4e6b512ab9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 138035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV Recharge Pro DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV Recharge Pro DCT',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980237%27 HTTP/1.1" 200 None
2026-03-25 22:53:10 [ayvens.be] INFO: Saving data for 1980237: {'auction_closing_time': 1774530000.0, 'created_time': 1774392556.54588, 'last_price_update_time': 1774479190.413201}
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980237') HTTP/1.1" 204 0
2026-03-25 22:53:10 [ayvens.be] INFO: Found listing with ID: 1980238
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980238%27 HTTP/1.1" 200 None
2026-03-25 22:53:10 [ayvens.be] INFO: Scrape type for 1980238: 2
2026-03-25 22:53:10 [ayvens.be] INFO: Extracting data for car ID: 1980238
2026-03-25 22:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-25 22:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 2
2026-03-25 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99a21a0-6528-59bd-b83a-0a37275320b1 with scrape type 2
2026-03-25 22:53:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c99a21a0-6528-59bd-b83a-0a37275320b1, identifier: 1980238
2026-03-25 22:53:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-25 22:53:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238
2026-03-25 22:53:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c99a21a0-6528-59bd-b83a-0a37275320b1 with identifier: 1980238 to the API
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'NACRE WIT PARELKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c99a21a0-6528-59bd-b83a-0a37275320b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 126107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 ALLURE 7pl',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 ALLURE 7pl',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980238%27 HTTP/1.1" 200 None
2026-03-25 22:53:10 [ayvens.be] INFO: Saving data for 1980238: {'auction_closing_time': 1774530000.0, 'created_time': 1774392559.140419, 'last_price_update_time': 1774479190.882942}
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980238') HTTP/1.1" 204 0
2026-03-25 22:53:10 [ayvens.be] INFO: Found listing with ID: 1980239
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980239%27 HTTP/1.1" 200 None
2026-03-25 22:53:10 [ayvens.be] INFO: Scrape type for 1980239: 2
2026-03-25 22:53:10 [ayvens.be] INFO: Extracting data for car ID: 1980239
2026-03-25 22:53:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-25 22:53:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d664978-b2a9-5e27-8f5d-816862f2cc57 with scrape type 2
2026-03-25 22:53:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d664978-b2a9-5e27-8f5d-816862f2cc57 with scrape type 2
2026-03-25 22:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8d664978-b2a9-5e27-8f5d-816862f2cc57, identifier: 1980239
2026-03-25 22:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-25 22:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239
2026-03-25 22:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8d664978-b2a9-5e27-8f5d-816862f2cc57 with identifier: 1980239 to the API
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d664978-b2a9-5e27-8f5d-816862f2cc57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE GLE DIESEL (W167)',
 'odometer': 148382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE GLE DIESEL (W167) GLE 350 de 4-Matic PHEV',
 'transmission': 'automatic',
 'trim': 'GLE 350 de 4-Matic PHEV',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980239%27 HTTP/1.1" 200 None
2026-03-25 22:53:11 [ayvens.be] INFO: Saving data for 1980239: {'auction_closing_time': 1774530000.0, 'created_time': 1774392558.18903, 'last_price_update_time': 1774479191.642395}
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980239') HTTP/1.1" 204 0
2026-03-25 22:53:11 [ayvens.be] INFO: Found listing with ID: 1980240
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980240%27 HTTP/1.1" 200 None
2026-03-25 22:53:11 [ayvens.be] INFO: Scrape type for 1980240: 2
2026-03-25 22:53:11 [ayvens.be] INFO: Extracting data for car ID: 1980240
2026-03-25 22:53:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-25 22:53:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9f152f-4974-5408-8a46-f15aa26e16f8 with scrape type 2
2026-03-25 22:53:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f9f152f-4974-5408-8a46-f15aa26e16f8 with scrape type 2
2026-03-25 22:53:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7f9f152f-4974-5408-8a46-f15aa26e16f8, identifier: 1980240
2026-03-25 22:53:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-25 22:53:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240
2026-03-25 22:53:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7f9f152f-4974-5408-8a46-f15aa26e16f8 with identifier: 1980240 to the API
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f9f152f-4974-5408-8a46-f15aa26e16f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'TARRACO',
 'odometer': 121297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT TARRACO 2.0 TDI 110KW MOVE DCT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW MOVE DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980240%27 HTTP/1.1" 200 None
2026-03-25 22:53:11 [ayvens.be] INFO: Saving data for 1980240: {'auction_closing_time': 1774530000.0, 'created_time': 1774392560.265069, 'last_price_update_time': 1774479191.998685}
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980240') HTTP/1.1" 204 0
2026-03-25 22:53:12 [ayvens.be] INFO: Found listing with ID: 1980241
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980241%27 HTTP/1.1" 200 None
2026-03-25 22:53:12 [ayvens.be] INFO: Scrape type for 1980241: 2
2026-03-25 22:53:12 [ayvens.be] INFO: Extracting data for car ID: 1980241
2026-03-25 22:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-25 22:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb, identifier: 1980241
2026-03-25 22:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-25 22:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241
2026-03-25 22:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 102740f9-a11d-52fd-a67d-bdfa14b5e0fb with identifier: 1980241 to the API
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '102740f9-a11d-52fd-a67d-bdfa14b5e0fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 125107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 dA sDrive16 AdBlue',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16 AdBlue',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980241%27 HTTP/1.1" 200 None
2026-03-25 22:53:12 [ayvens.be] INFO: Saving data for 1980241: {'auction_closing_time': 1774530000.0, 'created_time': 1774392562.117712, 'last_price_update_time': 1774479192.38821}
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980241') HTTP/1.1" 204 0
2026-03-25 22:53:12 [ayvens.be] INFO: Found listing with ID: 1980242
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980242%27 HTTP/1.1" 200 None
2026-03-25 22:53:12 [ayvens.be] INFO: Scrape type for 1980242: 2
2026-03-25 22:53:12 [ayvens.be] INFO: Extracting data for car ID: 1980242
2026-03-25 22:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-25 22:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a40385-f5bc-5f14-9f50-1a72103c4e51 with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a40385-f5bc-5f14-9f50-1a72103c4e51 with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a4a40385-f5bc-5f14-9f50-1a72103c4e51, identifier: 1980242
2026-03-25 22:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-25 22:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242
2026-03-25 22:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a4a40385-f5bc-5f14-9f50-1a72103c4e51 with identifier: 1980242 to the API
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a4a40385-f5bc-5f14-9f50-1a72103c4e51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': 'POLESTAR 2',
 'odometer': 138765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR POLESTAR 2 78 kWh Dual Motor Launch',
 'transmission': 'automatic',
 'trim': '78 kWh Dual Motor Launch',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980242%27 HTTP/1.1" 200 None
2026-03-25 22:53:12 [ayvens.be] INFO: Saving data for 1980242: {'auction_closing_time': 1774530000.0, 'created_time': 1774392562.947547, 'last_price_update_time': 1774479192.750001}
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980242') HTTP/1.1" 204 0
2026-03-25 22:53:12 [ayvens.be] INFO: Found listing with ID: 1980243
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980243%27 HTTP/1.1" 200 None
2026-03-25 22:53:12 [ayvens.be] INFO: Scrape type for 1980243: 2
2026-03-25 22:53:12 [ayvens.be] INFO: Extracting data for car ID: 1980243
2026-03-25 22:53:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-25 22:53:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with scrape type 2
2026-03-25 22:53:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce, identifier: 1980243
2026-03-25 22:53:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-25 22:53:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243
2026-03-25 22:53:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67b5b8e4-126d-509d-8cc6-62cdd828b0ce with identifier: 1980243 to the API
2026-03-25 22:53:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '67b5b8e4-126d-509d-8cc6-62cdd828b0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 142512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 30 TDI 100KW S TR BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980243%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Saving data for 1980243: {'auction_closing_time': 1774530000.0, 'created_time': 1774392564.552657, 'last_price_update_time': 1774479193.116725}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980243') HTTP/1.1" 204 0
2026-03-25 22:53:13 [ayvens.be] INFO: Found listing with ID: 1980244
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980244%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Scrape type for 1980244: 2
2026-03-25 22:53:13 [ayvens.be] INFO: Extracting data for car ID: 1980244
2026-03-25 22:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-25 22:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9129de0-b3cc-56eb-8492-96e4712690fb with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d9129de0-b3cc-56eb-8492-96e4712690fb, identifier: 1980244
2026-03-25 22:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-25 22:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244
2026-03-25 22:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d9129de0-b3cc-56eb-8492-96e4712690fb with identifier: 1980244 to the API
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd9129de0-b3cc-56eb-8492-96e4712690fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE - 2019',
 'odometer': 53507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE - 2019 2.0 Turbo 4WD R-Dynamic HSE',
 'transmission': 'automatic',
 'trim': '2.0 Turbo 4WD R-Dynamic HSE',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980244%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Saving data for 1980244: {'auction_closing_time': 1774530000.0, 'created_time': 1774392566.943399, 'last_price_update_time': 1774479193.476728}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980244') HTTP/1.1" 204 0
2026-03-25 22:53:13 [ayvens.be] INFO: Found listing with ID: 1980245
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980245%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Scrape type for 1980245: 2
2026-03-25 22:53:13 [ayvens.be] INFO: Extracting data for car ID: 1980245
2026-03-25 22:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-25 22:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a2e04f41-d376-5af6-88b1-4d1b9319a3f0, identifier: 1980245
2026-03-25 22:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-25 22:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245
2026-03-25 22:53:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a2e04f41-d376-5af6-88b1-4d1b9319a3f0 with identifier: 1980245 to the API
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a2e04f41-d376-5af6-88b1-4d1b9319a3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 78299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980245%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Saving data for 1980245: {'auction_closing_time': 1774530000.0, 'created_time': 1774392568.330206, 'last_price_update_time': 1774479193.85731}
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980245') HTTP/1.1" 204 0
2026-03-25 22:53:13 [ayvens.be] INFO: Found listing with ID: 1980246
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980246%27 HTTP/1.1" 200 None
2026-03-25 22:53:13 [ayvens.be] INFO: Scrape type for 1980246: 2
2026-03-25 22:53:13 [ayvens.be] INFO: Extracting data for car ID: 1980246
2026-03-25 22:53:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-25 22:53:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e732670e-563c-5163-874a-0d3d7a0beee3 with scrape type 2
2026-03-25 22:53:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e732670e-563c-5163-874a-0d3d7a0beee3, identifier: 1980246
2026-03-25 22:53:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-25 22:53:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246
2026-03-25 22:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e732670e-563c-5163-874a-0d3d7a0beee3 with identifier: 1980246 to the API
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e732670e-563c-5163-874a-0d3d7a0beee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 71471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 250 BUSINESS LINE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980246%27 HTTP/1.1" 200 None
2026-03-25 22:53:14 [ayvens.be] INFO: Saving data for 1980246: {'auction_closing_time': 1774530000.0, 'created_time': 1774392569.724528, 'last_price_update_time': 1774479194.234659}
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980246') HTTP/1.1" 204 0
2026-03-25 22:53:14 [ayvens.be] INFO: Found listing with ID: 1980247
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980247%27 HTTP/1.1" 200 None
2026-03-25 22:53:14 [ayvens.be] INFO: Scrape type for 1980247: 2
2026-03-25 22:53:14 [ayvens.be] INFO: Extracting data for car ID: 1980247
2026-03-25 22:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-25 22:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 2
2026-03-25 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e48b0d-73c6-561d-946b-a94fc8b7222f with scrape type 2
2026-03-25 22:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70e48b0d-73c6-561d-946b-a94fc8b7222f, identifier: 1980247
2026-03-25 22:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-25 22:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247
2026-03-25 22:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70e48b0d-73c6-561d-946b-a94fc8b7222f with identifier: 1980247 to the API
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '70e48b0d-73c6-561d-946b-a94fc8b7222f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 49781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 CLA 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980247%27 HTTP/1.1" 200 None
2026-03-25 22:53:14 [ayvens.be] INFO: Saving data for 1980247: {'auction_closing_time': 1774530000.0, 'created_time': 1774392570.953496, 'last_price_update_time': 1774479194.609237}
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980247') HTTP/1.1" 204 0
2026-03-25 22:53:14 [ayvens.be] INFO: Found listing with ID: 1980248
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980248%27 HTTP/1.1" 200 None
2026-03-25 22:53:14 [ayvens.be] INFO: Scrape type for 1980248: 2
2026-03-25 22:53:14 [ayvens.be] INFO: Extracting data for car ID: 1980248
2026-03-25 22:53:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-25 22:53:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 2
2026-03-25 22:53:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with scrape type 2
2026-03-25 22:53:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877, identifier: 1980248
2026-03-25 22:53:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-25 22:53:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248
2026-03-25 22:53:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877 with identifier: 1980248 to the API
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1ff5f81-8d7f-5e22-b9cb-10ba9b5a2877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 116744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980248%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Saving data for 1980248: {'auction_closing_time': 1774530000.0, 'created_time': 1774392572.509631, 'last_price_update_time': 1774479195.010577}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980248') HTTP/1.1" 204 0
2026-03-25 22:53:15 [ayvens.be] INFO: Found listing with ID: 1980249
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980249%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Scrape type for 1980249: 2
2026-03-25 22:53:15 [ayvens.be] INFO: Extracting data for car ID: 1980249
2026-03-25 22:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-25 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 2
2026-03-25 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 204b260e-559e-573a-a182-0234b1a52c5d with scrape type 2
2026-03-25 22:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 204b260e-559e-573a-a182-0234b1a52c5d, identifier: 1980249
2026-03-25 22:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-25 22:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249
2026-03-25 22:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 204b260e-559e-573a-a182-0234b1a52c5d with identifier: 1980249 to the API
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '204b260e-559e-573a-a182-0234b1a52c5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 46415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO8 ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980249%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Saving data for 1980249: {'auction_closing_time': 1774530000.0, 'created_time': 1774392573.815702, 'last_price_update_time': 1774479195.507127}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980249') HTTP/1.1" 204 0
2026-03-25 22:53:15 [ayvens.be] INFO: Found listing with ID: 1980250
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980250%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Scrape type for 1980250: 2
2026-03-25 22:53:15 [ayvens.be] INFO: Extracting data for car ID: 1980250
2026-03-25 22:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-25 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 2
2026-03-25 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cd1f4af-ca6c-5179-834b-195bc36a2958 with scrape type 2
2026-03-25 22:53:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cd1f4af-ca6c-5179-834b-195bc36a2958, identifier: 1980250
2026-03-25 22:53:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-25 22:53:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250
2026-03-25 22:53:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cd1f4af-ca6c-5179-834b-195bc36a2958 with identifier: 1980250 to the API
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2cd1f4af-ca6c-5179-834b-195bc36a2958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 107677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 110KW CLEVER+',
 'transmission': 'manual',
 'trim': '2.0 CRTDI 110KW CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980250%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Saving data for 1980250: {'auction_closing_time': 1774530000.0, 'created_time': 1774392576.189487, 'last_price_update_time': 1774479195.930705}
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980250') HTTP/1.1" 204 0
2026-03-25 22:53:15 [ayvens.be] INFO: Found listing with ID: 1980251
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980251%27 HTTP/1.1" 200 None
2026-03-25 22:53:15 [ayvens.be] INFO: Scrape type for 1980251: 2
2026-03-25 22:53:15 [ayvens.be] INFO: Extracting data for car ID: 1980251
2026-03-25 22:53:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-25 22:53:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 2
2026-03-25 22:53:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d435f3e0-529f-510b-bac6-ad11c65d9078 with scrape type 2
2026-03-25 22:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d435f3e0-529f-510b-bac6-ad11c65d9078, identifier: 1980251
2026-03-25 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-25 22:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251
2026-03-25 22:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d435f3e0-529f-510b-bac6-ad11c65d9078 with identifier: 1980251 to the API
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'd435f3e0-529f-510b-bac6-ad11c65d9078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 188744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 78KWH RECHARGE TWIN PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH RECHARGE TWIN PLUS',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980251%27 HTTP/1.1" 200 None
2026-03-25 22:53:16 [ayvens.be] INFO: Saving data for 1980251: {'auction_closing_time': 1774530000.0, 'created_time': 1774392577.642219, 'last_price_update_time': 1774479196.313221}
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980251') HTTP/1.1" 204 0
2026-03-25 22:53:16 [ayvens.be] INFO: Found listing with ID: 1980252
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980252%27 HTTP/1.1" 200 None
2026-03-25 22:53:16 [ayvens.be] INFO: Scrape type for 1980252: 2
2026-03-25 22:53:16 [ayvens.be] INFO: Extracting data for car ID: 1980252
2026-03-25 22:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-25 22:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 2
2026-03-25 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with scrape type 2
2026-03-25 22:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02, identifier: 1980252
2026-03-25 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-25 22:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252
2026-03-25 22:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b30eb02b-510e-5cce-8b0c-c2f43e8c5e02 with identifier: 1980252 to the API
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b30eb02b-510e-5cce-8b0c-c2f43e8c5e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 54790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980252%27 HTTP/1.1" 200 None
2026-03-25 22:53:16 [ayvens.be] INFO: Saving data for 1980252: {'auction_closing_time': 1774530000.0, 'created_time': 1774392580.303836, 'last_price_update_time': 1774479196.711892}
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980252') HTTP/1.1" 204 0
2026-03-25 22:53:16 [ayvens.be] INFO: Found listing with ID: 1980253
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980253%27 HTTP/1.1" 200 None
2026-03-25 22:53:16 [ayvens.be] INFO: Scrape type for 1980253: 2
2026-03-25 22:53:16 [ayvens.be] INFO: Extracting data for car ID: 1980253
2026-03-25 22:53:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-25 22:53:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with scrape type 2
2026-03-25 22:53:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with scrape type 2
2026-03-25 22:53:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596, identifier: 1980253
2026-03-25 22:53:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-25 22:53:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253
2026-03-25 22:53:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71cde7f2-aa02-5bb5-a9d0-0db0d127d596 with identifier: 1980253 to the API
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '71cde7f2-aa02-5bb5-a9d0-0db0d127d596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 109444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980253%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Saving data for 1980253: {'auction_closing_time': 1774530000.0, 'created_time': 1774392581.824697, 'last_price_update_time': 1774479197.100729}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980253') HTTP/1.1" 204 0
2026-03-25 22:53:17 [ayvens.be] INFO: Found listing with ID: 1980254
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980254%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Scrape type for 1980254: 2
2026-03-25 22:53:17 [ayvens.be] INFO: Extracting data for car ID: 1980254
2026-03-25 22:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-25 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 2
2026-03-25 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773e2031-4730-5eec-ada3-05f112376a35 with scrape type 2
2026-03-25 22:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 773e2031-4730-5eec-ada3-05f112376a35, identifier: 1980254
2026-03-25 22:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-25 22:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254
2026-03-25 22:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 773e2031-4730-5eec-ada3-05f112376a35 with identifier: 1980254 to the API
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '773e2031-4730-5eec-ada3-05f112376a35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 77912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980254%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Saving data for 1980254: {'auction_closing_time': 1774530000.0, 'created_time': 1774392584.399414, 'last_price_update_time': 1774479197.491737}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980254') HTTP/1.1" 204 0
2026-03-25 22:53:17 [ayvens.be] INFO: Found listing with ID: 1980255
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980255%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Scrape type for 1980255: 2
2026-03-25 22:53:17 [ayvens.be] INFO: Extracting data for car ID: 1980255
2026-03-25 22:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-25 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 2
2026-03-25 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with scrape type 2
2026-03-25 22:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5b0f1bfc-61ef-5df4-9193-0b96111023d6, identifier: 1980255
2026-03-25 22:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-25 22:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255
2026-03-25 22:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5b0f1bfc-61ef-5df4-9193-0b96111023d6 with identifier: 1980255 to the API
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b0f1bfc-61ef-5df4-9193-0b96111023d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Golf',
 'odometer': 123123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Golf 2.0 TDI 110KW DSG LIFE',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW DSG LIFE',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980255%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Saving data for 1980255: {'auction_closing_time': 1774530000.0, 'created_time': 1774392585.148626, 'last_price_update_time': 1774479197.881197}
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980255') HTTP/1.1" 204 0
2026-03-25 22:53:17 [ayvens.be] INFO: Found listing with ID: 1980256
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980256%27 HTTP/1.1" 200 None
2026-03-25 22:53:17 [ayvens.be] INFO: Scrape type for 1980256: 2
2026-03-25 22:53:17 [ayvens.be] INFO: Extracting data for car ID: 1980256
2026-03-25 22:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-25 22:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 2
2026-03-25 22:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85724f90-0dfe-56d9-843c-ec02c68eed02 with scrape type 2
2026-03-25 22:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85724f90-0dfe-56d9-843c-ec02c68eed02, identifier: 1980256
2026-03-25 22:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-25 22:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256
2026-03-25 22:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85724f90-0dfe-56d9-843c-ec02c68eed02 with identifier: 1980256 to the API
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '85724f90-0dfe-56d9-843c-ec02c68eed02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 126988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980256%27 HTTP/1.1" 200 None
2026-03-25 22:53:18 [ayvens.be] INFO: Saving data for 1980256: {'auction_closing_time': 1774530000.0, 'created_time': 1774392586.023156, 'last_price_update_time': 1774479198.268227}
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980256') HTTP/1.1" 204 0
2026-03-25 22:53:18 [ayvens.be] INFO: Found listing with ID: 1980257
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980257%27 HTTP/1.1" 200 None
2026-03-25 22:53:18 [ayvens.be] INFO: Scrape type for 1980257: 2
2026-03-25 22:53:18 [ayvens.be] INFO: Extracting data for car ID: 1980257
2026-03-25 22:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-25 22:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 2
2026-03-25 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d047eea3-306f-5f94-83ed-56eb33ac1de2 with scrape type 2
2026-03-25 22:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d047eea3-306f-5f94-83ed-56eb33ac1de2, identifier: 1980257
2026-03-25 22:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-25 22:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257
2026-03-25 22:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d047eea3-306f-5f94-83ed-56eb33ac1de2 with identifier: 1980257 to the API
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd047eea3-306f-5f94-83ed-56eb33ac1de2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 74124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980257%27 HTTP/1.1" 200 None
2026-03-25 22:53:18 [ayvens.be] INFO: Saving data for 1980257: {'auction_closing_time': 1774530000.0, 'created_time': 1774392588.432627, 'last_price_update_time': 1774479198.65435}
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980257') HTTP/1.1" 204 0
2026-03-25 22:53:18 [ayvens.be] INFO: Found listing with ID: 1980258
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980258%27 HTTP/1.1" 200 None
2026-03-25 22:53:18 [ayvens.be] INFO: Scrape type for 1980258: 2
2026-03-25 22:53:18 [ayvens.be] INFO: Extracting data for car ID: 1980258
2026-03-25 22:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-25 22:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 2
2026-03-25 22:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b87bb0-cccb-5170-837d-4e434418cb6c with scrape type 2
2026-03-25 22:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 70b87bb0-cccb-5170-837d-4e434418cb6c, identifier: 1980258
2026-03-25 22:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-25 22:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258
2026-03-25 22:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 70b87bb0-cccb-5170-837d-4e434418cb6c with identifier: 1980258 to the API
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '70b87bb0-cccb-5170-837d-4e434418cb6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 75053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 PLUS DARK DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '1.5 T2 PLUS DARK DESIGN AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980258%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Saving data for 1980258: {'auction_closing_time': 1774530000.0, 'created_time': 1774392589.955766, 'last_price_update_time': 1774479199.026214}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980258') HTTP/1.1" 204 0
2026-03-25 22:53:19 [ayvens.be] INFO: Found listing with ID: 1980259
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980259%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Scrape type for 1980259: 2
2026-03-25 22:53:19 [ayvens.be] INFO: Extracting data for car ID: 1980259
2026-03-25 22:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-25 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39b1ac-7f25-5b74-bf05-330c85f41744 with scrape type 2
2026-03-25 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc39b1ac-7f25-5b74-bf05-330c85f41744 with scrape type 2
2026-03-25 22:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc39b1ac-7f25-5b74-bf05-330c85f41744, identifier: 1980259
2026-03-25 22:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-25 22:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259
2026-03-25 22:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dc39b1ac-7f25-5b74-bf05-330c85f41744 with identifier: 1980259 to the API
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc39b1ac-7f25-5b74-bf05-330c85f41744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 200210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 D165 MHEV S 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 D165 MHEV S 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980259%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Saving data for 1980259: {'auction_closing_time': 1774530000.0, 'created_time': 1774392590.704586, 'last_price_update_time': 1774479199.400717}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980259') HTTP/1.1" 204 0
2026-03-25 22:53:19 [ayvens.be] INFO: Found listing with ID: 1980260
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980260%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Scrape type for 1980260: 2
2026-03-25 22:53:19 [ayvens.be] INFO: Extracting data for car ID: 1980260
2026-03-25 22:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-25 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 2
2026-03-25 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 641cc868-a13f-553c-85d9-2731744fa2f3 with scrape type 2
2026-03-25 22:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 641cc868-a13f-553c-85d9-2731744fa2f3, identifier: 1980260
2026-03-25 22:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-25 22:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260
2026-03-25 22:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 641cc868-a13f-553c-85d9-2731744fa2f3 with identifier: 1980260 to the API
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '641cc868-a13f-553c-85d9-2731744fa2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 116371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980260%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Saving data for 1980260: {'auction_closing_time': 1774530000.0, 'created_time': 1774392593.123285, 'last_price_update_time': 1774479199.880358}
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980260') HTTP/1.1" 204 0
2026-03-25 22:53:19 [ayvens.be] INFO: Found listing with ID: 1980261
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980261%27 HTTP/1.1" 200 None
2026-03-25 22:53:19 [ayvens.be] INFO: Scrape type for 1980261: 2
2026-03-25 22:53:19 [ayvens.be] INFO: Extracting data for car ID: 1980261
2026-03-25 22:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-25 22:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 2
2026-03-25 22:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeb29561-e158-5223-bfca-38b14132c135 with scrape type 2
2026-03-25 22:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aeb29561-e158-5223-bfca-38b14132c135, identifier: 1980261
2026-03-25 22:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-25 22:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261
2026-03-25 22:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: aeb29561-e158-5223-bfca-38b14132c135 with identifier: 1980261 to the API
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'aeb29561-e158-5223-bfca-38b14132c135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 63948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980261%27 HTTP/1.1" 200 None
2026-03-25 22:53:20 [ayvens.be] INFO: Saving data for 1980261: {'auction_closing_time': 1774530000.0, 'created_time': 1774392594.640073, 'last_price_update_time': 1774479200.258418}
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980261') HTTP/1.1" 204 0
2026-03-25 22:53:20 [ayvens.be] INFO: Found listing with ID: 1980262
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980262%27 HTTP/1.1" 200 None
2026-03-25 22:53:20 [ayvens.be] INFO: Scrape type for 1980262: 2
2026-03-25 22:53:20 [ayvens.be] INFO: Extracting data for car ID: 1980262
2026-03-25 22:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-25 22:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bf7132-43ae-581a-92d0-43010c2c45ae with scrape type 2
2026-03-25 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21bf7132-43ae-581a-92d0-43010c2c45ae with scrape type 2
2026-03-25 22:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21bf7132-43ae-581a-92d0-43010c2c45ae, identifier: 1980262
2026-03-25 22:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-25 22:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262
2026-03-25 22:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21bf7132-43ae-581a-92d0-43010c2c45ae with identifier: 1980262 to the API
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '21bf7132-43ae-581a-92d0-43010c2c45ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980262%27 HTTP/1.1" 200 None
2026-03-25 22:53:20 [ayvens.be] INFO: Saving data for 1980262: {'auction_closing_time': 1774530000.0, 'created_time': 1774392596.061092, 'last_price_update_time': 1774479200.629319}
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980262') HTTP/1.1" 204 0
2026-03-25 22:53:20 [ayvens.be] INFO: Found listing with ID: 1980263
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980263%27 HTTP/1.1" 200 None
2026-03-25 22:53:20 [ayvens.be] INFO: Scrape type for 1980263: 2
2026-03-25 22:53:20 [ayvens.be] INFO: Extracting data for car ID: 1980263
2026-03-25 22:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-25 22:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 2
2026-03-25 22:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5926a4-868d-51d5-b909-123e0d888f17 with scrape type 2
2026-03-25 22:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f5926a4-868d-51d5-b909-123e0d888f17, identifier: 1980263
2026-03-25 22:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-25 22:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263
2026-03-25 22:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f5926a4-868d-51d5-b909-123e0d888f17 with identifier: 1980263 to the API
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f5926a4-868d-51d5-b909-123e0d888f17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 114303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH PLUG-IN HYBRID INITIALE PARIS',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980263%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Saving data for 1980263: {'auction_closing_time': 1774530000.0, 'created_time': 1774392597.14881, 'last_price_update_time': 1774479201.026148}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980263') HTTP/1.1" 204 0
2026-03-25 22:53:21 [ayvens.be] INFO: Found listing with ID: 1980264
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980264%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Scrape type for 1980264: 2
2026-03-25 22:53:21 [ayvens.be] INFO: Extracting data for car ID: 1980264
2026-03-25 22:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-25 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5, identifier: 1980264
2026-03-25 22:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-25 22:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264
2026-03-25 22:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5 with identifier: 1980264 to the API
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c1a6e368-6dd7-58a3-ab83-5b0ceb2b0fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 74237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980264%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Saving data for 1980264: {'auction_closing_time': 1774530000.0, 'created_time': 1774392598.789259, 'last_price_update_time': 1774479201.410281}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980264') HTTP/1.1" 204 0
2026-03-25 22:53:21 [ayvens.be] INFO: Found listing with ID: 1980265
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980265%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Scrape type for 1980265: 2
2026-03-25 22:53:21 [ayvens.be] INFO: Extracting data for car ID: 1980265
2026-03-25 22:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-25 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0dfdf38a-a3e5-5784-828a-f0c31612ee66, identifier: 1980265
2026-03-25 22:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-25 22:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265
2026-03-25 22:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0dfdf38a-a3e5-5784-828a-f0c31612ee66 with identifier: 1980265 to the API
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0dfdf38a-a3e5-5784-828a-f0c31612ee66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 42466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980265%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Saving data for 1980265: {'auction_closing_time': 1774530000.0, 'created_time': 1774392600.377467, 'last_price_update_time': 1774479201.793765}
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980265') HTTP/1.1" 204 0
2026-03-25 22:53:21 [ayvens.be] INFO: Found listing with ID: 1980266
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980266%27 HTTP/1.1" 200 None
2026-03-25 22:53:21 [ayvens.be] INFO: Scrape type for 1980266: 2
2026-03-25 22:53:21 [ayvens.be] INFO: Extracting data for car ID: 1980266
2026-03-25 22:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-25 22:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84ff5c32-098b-5760-9181-7ea2e0123afc with scrape type 2
2026-03-25 22:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84ff5c32-098b-5760-9181-7ea2e0123afc, identifier: 1980266
2026-03-25 22:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-25 22:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266
2026-03-25 22:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 84ff5c32-098b-5760-9181-7ea2e0123afc with identifier: 1980266 to the API
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '84ff5c32-098b-5760-9181-7ea2e0123afc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 49153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQB 300 AMG LINE AUTO 4M',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980266%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Saving data for 1980266: {'auction_closing_time': 1774530000.0, 'created_time': 1774392604.192612, 'last_price_update_time': 1774479202.163821}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980266') HTTP/1.1" 204 0
2026-03-25 22:53:22 [ayvens.be] INFO: Found listing with ID: 1980267
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980267%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Scrape type for 1980267: 2
2026-03-25 22:53:22 [ayvens.be] INFO: Extracting data for car ID: 1980267
2026-03-25 22:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-25 22:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 2
2026-03-25 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with scrape type 2
2026-03-25 22:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7, identifier: 1980267
2026-03-25 22:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-25 22:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267
2026-03-25 22:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8e32f3c2-1201-53f9-a2fc-ea44d56970a7 with identifier: 1980267 to the API
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e32f3c2-1201-53f9-a2fc-ea44d56970a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 91408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980267%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Saving data for 1980267: {'auction_closing_time': 1774530000.0, 'created_time': 1774392605.080227, 'last_price_update_time': 1774479202.543749}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980267') HTTP/1.1" 204 0
2026-03-25 22:53:22 [ayvens.be] INFO: Found listing with ID: 1980268
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980268%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Scrape type for 1980268: 2
2026-03-25 22:53:22 [ayvens.be] INFO: Extracting data for car ID: 1980268
2026-03-25 22:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-25 22:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 2
2026-03-25 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4861b22-3a31-5b05-984b-5666753bb4c0 with scrape type 2
2026-03-25 22:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b4861b22-3a31-5b05-984b-5666753bb4c0, identifier: 1980268
2026-03-25 22:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-25 22:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268
2026-03-25 22:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b4861b22-3a31-5b05-984b-5666753bb4c0 with identifier: 1980268 to the API
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4861b22-3a31-5b05-984b-5666753bb4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 65837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980268%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Saving data for 1980268: {'auction_closing_time': 1774530000.0, 'created_time': 1774392607.185335, 'last_price_update_time': 1774479202.938792}
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980268') HTTP/1.1" 204 0
2026-03-25 22:53:22 [ayvens.be] INFO: Found listing with ID: 1980269
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980269%27 HTTP/1.1" 200 None
2026-03-25 22:53:22 [ayvens.be] INFO: Scrape type for 1980269: 2
2026-03-25 22:53:22 [ayvens.be] INFO: Extracting data for car ID: 1980269
2026-03-25 22:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-25 22:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e with scrape type 2
2026-03-25 22:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 199ab21c-1cd9-5623-98ea-15f33b9eca6e with scrape type 2
2026-03-25 22:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 199ab21c-1cd9-5623-98ea-15f33b9eca6e, identifier: 1980269
2026-03-25 22:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-25 22:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269
2026-03-25 22:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 199ab21c-1cd9-5623-98ea-15f33b9eca6e with identifier: 1980269 to the API
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '199ab21c-1cd9-5623-98ea-15f33b9eca6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPAu2030',
 'odometer': 127414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPAu2030 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980269%27 HTTP/1.1" 200 None
2026-03-25 22:53:23 [ayvens.be] INFO: Saving data for 1980269: {'auction_closing_time': 1774530000.0, 'created_time': 1774392608.955247, 'last_price_update_time': 1774479203.359252}
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980269') HTTP/1.1" 204 0
2026-03-25 22:53:23 [ayvens.be] INFO: Found listing with ID: 1980270
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980270%27 HTTP/1.1" 200 None
2026-03-25 22:53:23 [ayvens.be] INFO: Scrape type for 1980270: 2
2026-03-25 22:53:23 [ayvens.be] INFO: Extracting data for car ID: 1980270
2026-03-25 22:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-25 22:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 2
2026-03-25 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with scrape type 2
2026-03-25 22:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddafa458-3cf3-57c1-abb3-73f34a7dfa14, identifier: 1980270
2026-03-25 22:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-25 22:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270
2026-03-25 22:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddafa458-3cf3-57c1-abb3-73f34a7dfa14 with identifier: 1980270 to the API
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ddafa458-3cf3-57c1-abb3-73f34a7dfa14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 85430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980270%27 HTTP/1.1" 200 None
2026-03-25 22:53:23 [ayvens.be] INFO: Saving data for 1980270: {'auction_closing_time': 1774530000.0, 'created_time': 1774392610.194344, 'last_price_update_time': 1774479203.745056}
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980270') HTTP/1.1" 204 0
2026-03-25 22:53:23 [ayvens.be] INFO: Found listing with ID: 1980271
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980271%27 HTTP/1.1" 200 None
2026-03-25 22:53:23 [ayvens.be] INFO: Scrape type for 1980271: 2
2026-03-25 22:53:23 [ayvens.be] INFO: Extracting data for car ID: 1980271
2026-03-25 22:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-25 22:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 2
2026-03-25 22:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe589cd-55eb-56c1-a18a-eb475b284f11 with scrape type 2
2026-03-25 22:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fe589cd-55eb-56c1-a18a-eb475b284f11, identifier: 1980271
2026-03-25 22:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-25 22:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271
2026-03-25 22:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fe589cd-55eb-56c1-a18a-eb475b284f11 with identifier: 1980271 to the API
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fe589cd-55eb-56c1-a18a-eb475b284f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 135693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980271%27 HTTP/1.1" 200 None
2026-03-25 22:53:24 [ayvens.be] INFO: Saving data for 1980271: {'auction_closing_time': 1774530000.0, 'created_time': 1774392611.92864, 'last_price_update_time': 1774479204.209975}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980271') HTTP/1.1" 204 0
2026-03-25 22:53:24 [ayvens.be] INFO: Found listing with ID: 1980272
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980272%27 HTTP/1.1" 200 None
2026-03-25 22:53:24 [ayvens.be] INFO: Scrape type for 1980272: 2
2026-03-25 22:53:24 [ayvens.be] INFO: Extracting data for car ID: 1980272
2026-03-25 22:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-25 22:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9155e206-88ff-5b8a-9de4-bc24e1c42175 with scrape type 2
2026-03-25 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9155e206-88ff-5b8a-9de4-bc24e1c42175 with scrape type 2
2026-03-25 22:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9155e206-88ff-5b8a-9de4-bc24e1c42175, identifier: 1980272
2026-03-25 22:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-25 22:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272
2026-03-25 22:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9155e206-88ff-5b8a-9de4-bc24e1c42175 with identifier: 1980272 to the API
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '9155e206-88ff-5b8a-9de4-bc24e1c42175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 103561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980272%27 HTTP/1.1" 200 None
2026-03-25 22:53:24 [ayvens.be] INFO: Saving data for 1980272: {'auction_closing_time': 1774530000.0, 'created_time': 1774392613.099271, 'last_price_update_time': 1774479204.590145}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980272') HTTP/1.1" 204 0
2026-03-25 22:53:24 [ayvens.be] INFO: Found listing with ID: 1980273
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980273%27 HTTP/1.1" 200 None
2026-03-25 22:53:24 [ayvens.be] INFO: Scrape type for 1980273: 2
2026-03-25 22:53:24 [ayvens.be] INFO: Extracting data for car ID: 1980273
2026-03-25 22:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-25 22:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 2
2026-03-25 22:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with scrape type 2
2026-03-25 22:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c, identifier: 1980273
2026-03-25 22:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-25 22:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273
2026-03-25 22:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a53da03-7f2a-5801-ba2a-6387e94f4c8c with identifier: 1980273 to the API
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a53da03-7f2a-5801-ba2a-6387e94f4c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 17867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980273%27 HTTP/1.1" 200 None
2026-03-25 22:53:24 [ayvens.be] INFO: Saving data for 1980273: {'auction_closing_time': 1774530000.0, 'created_time': 1774392614.377152, 'last_price_update_time': 1774479204.988801}
2026-03-25 22:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980273') HTTP/1.1" 204 0
2026-03-25 22:53:25 [ayvens.be] INFO: Found listing with ID: 1980274
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980274%27 HTTP/1.1" 200 None
2026-03-25 22:53:25 [ayvens.be] INFO: Scrape type for 1980274: 2
2026-03-25 22:53:25 [ayvens.be] INFO: Extracting data for car ID: 1980274
2026-03-25 22:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-25 22:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77, identifier: 1980274
2026-03-25 22:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-25 22:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274
2026-03-25 22:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77 with identifier: 1980274 to the API
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '9bbedb24-f36b-5eb6-a1cc-e6d26b6a6e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2 DIESEL',
 'odometer': 85006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 DIESEL 1.5 dA sDrive16',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980274%27 HTTP/1.1" 200 None
2026-03-25 22:53:25 [ayvens.be] INFO: Saving data for 1980274: {'auction_closing_time': 1774530000.0, 'created_time': 1774392615.47338, 'last_price_update_time': 1774479205.351302}
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980274') HTTP/1.1" 204 0
2026-03-25 22:53:25 [ayvens.be] INFO: Found listing with ID: 1980275
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980275%27 HTTP/1.1" 200 None
2026-03-25 22:53:25 [ayvens.be] INFO: Scrape type for 1980275: 2
2026-03-25 22:53:25 [ayvens.be] INFO: Extracting data for car ID: 1980275
2026-03-25 22:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-25 22:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31776f69-743f-5210-afca-b1b6483e3e9e with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 31776f69-743f-5210-afca-b1b6483e3e9e, identifier: 1980275
2026-03-25 22:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-25 22:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275
2026-03-25 22:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 31776f69-743f-5210-afca-b1b6483e3e9e with identifier: 1980275 to the API
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '31776f69-743f-5210-afca-b1b6483e3e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 140122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980275%27 HTTP/1.1" 200 None
2026-03-25 22:53:25 [ayvens.be] INFO: Saving data for 1980275: {'auction_closing_time': 1774530000.0, 'created_time': 1774392618.077407, 'last_price_update_time': 1774479205.721999}
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980275') HTTP/1.1" 204 0
2026-03-25 22:53:25 [ayvens.be] INFO: Found listing with ID: 1980276
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980276%27 HTTP/1.1" 200 None
2026-03-25 22:53:25 [ayvens.be] INFO: Scrape type for 1980276: 2
2026-03-25 22:53:25 [ayvens.be] INFO: Extracting data for car ID: 1980276
2026-03-25 22:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-25 22:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d58cdd-aa50-5952-b531-46485dc8de9c with scrape type 2
2026-03-25 22:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6d58cdd-aa50-5952-b531-46485dc8de9c, identifier: 1980276
2026-03-25 22:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-25 22:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276
2026-03-25 22:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6d58cdd-aa50-5952-b531-46485dc8de9c with identifier: 1980276 to the API
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b6d58cdd-aa50-5952-b531-46485dc8de9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 79497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980276%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Saving data for 1980276: {'auction_closing_time': 1774530000.0, 'created_time': 1774392619.029101, 'last_price_update_time': 1774479206.136159}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980276') HTTP/1.1" 204 0
2026-03-25 22:53:26 [ayvens.be] INFO: Found listing with ID: 1980277
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980277%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Scrape type for 1980277: 2
2026-03-25 22:53:26 [ayvens.be] INFO: Extracting data for car ID: 1980277
2026-03-25 22:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-25 22:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 2
2026-03-25 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with scrape type 2
2026-03-25 22:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00efd6d5-bab1-54f3-8526-5077d1dd40f2, identifier: 1980277
2026-03-25 22:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-25 22:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277
2026-03-25 22:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00efd6d5-bab1-54f3-8526-5077d1dd40f2 with identifier: 1980277 to the API
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '00efd6d5-bab1-54f3-8526-5077d1dd40f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 78888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2.0TDCI 96KW TREND 350L',
 'transmission': 'manual',
 'trim': '2.0TDCI 96KW TREND 350L',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980277%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Saving data for 1980277: {'auction_closing_time': 1774530000.0, 'created_time': 1774392620.297853, 'last_price_update_time': 1774479206.537688}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980277') HTTP/1.1" 204 0
2026-03-25 22:53:26 [ayvens.be] INFO: Found listing with ID: 1980278
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980278%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Scrape type for 1980278: 2
2026-03-25 22:53:26 [ayvens.be] INFO: Extracting data for car ID: 1980278
2026-03-25 22:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-25 22:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12b266b9-7e3d-5de4-b274-228f59a3255d with scrape type 2
2026-03-25 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12b266b9-7e3d-5de4-b274-228f59a3255d with scrape type 2
2026-03-25 22:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 12b266b9-7e3d-5de4-b274-228f59a3255d, identifier: 1980278
2026-03-25 22:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-25 22:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278
2026-03-25 22:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 12b266b9-7e3d-5de4-b274-228f59a3255d with identifier: 1980278 to the API
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '12b266b9-7e3d-5de4-b274-228f59a3255d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 199248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980278%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Saving data for 1980278: {'auction_closing_time': 1774530000.0, 'created_time': 1774392622.536759, 'last_price_update_time': 1774479206.936511}
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980278') HTTP/1.1" 204 0
2026-03-25 22:53:26 [ayvens.be] INFO: Found listing with ID: 1980279
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980279%27 HTTP/1.1" 200 None
2026-03-25 22:53:26 [ayvens.be] INFO: Scrape type for 1980279: 2
2026-03-25 22:53:26 [ayvens.be] INFO: Extracting data for car ID: 1980279
2026-03-25 22:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-25 22:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 2
2026-03-25 22:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313dd6d5-92c8-50d8-8204-aa92b87058e7 with scrape type 2
2026-03-25 22:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 313dd6d5-92c8-50d8-8204-aa92b87058e7, identifier: 1980279
2026-03-25 22:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-25 22:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279
2026-03-25 22:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 313dd6d5-92c8-50d8-8204-aa92b87058e7 with identifier: 1980279 to the API
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '313dd6d5-92c8-50d8-8204-aa92b87058e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 63230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 64 KWH ELECTRIC SKY',
 'transmission': 'automatic',
 'trim': '64 KWH ELECTRIC SKY',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980279%27 HTTP/1.1" 200 None
2026-03-25 22:53:27 [ayvens.be] INFO: Saving data for 1980279: {'auction_closing_time': 1774530000.0, 'created_time': 1774392624.16806, 'last_price_update_time': 1774479207.32223}
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980279') HTTP/1.1" 204 0
2026-03-25 22:53:27 [ayvens.be] INFO: Found listing with ID: 1980280
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980280%27 HTTP/1.1" 200 None
2026-03-25 22:53:27 [ayvens.be] INFO: Scrape type for 1980280: 2
2026-03-25 22:53:27 [ayvens.be] INFO: Extracting data for car ID: 1980280
2026-03-25 22:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-25 22:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d16051d6-c829-5f14-947a-90fd03d73757 with scrape type 2
2026-03-25 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d16051d6-c829-5f14-947a-90fd03d73757 with scrape type 2
2026-03-25 22:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d16051d6-c829-5f14-947a-90fd03d73757, identifier: 1980280
2026-03-25 22:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-25 22:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280
2026-03-25 22:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d16051d6-c829-5f14-947a-90fd03d73757 with identifier: 1980280 to the API
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd16051d6-c829-5f14-947a-90fd03d73757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 101395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980280%27 HTTP/1.1" 200 None
2026-03-25 22:53:27 [ayvens.be] INFO: Saving data for 1980280: {'auction_closing_time': 1774530000.0, 'created_time': 1774392625.85694, 'last_price_update_time': 1774479207.707191}
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980280') HTTP/1.1" 204 0
2026-03-25 22:53:27 [ayvens.be] INFO: Found listing with ID: 1980281
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980281%27 HTTP/1.1" 200 None
2026-03-25 22:53:27 [ayvens.be] INFO: Scrape type for 1980281: 2
2026-03-25 22:53:27 [ayvens.be] INFO: Extracting data for car ID: 1980281
2026-03-25 22:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-25 22:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8009b226-ed8e-5f06-88fd-1423f9addacc with scrape type 2
2026-03-25 22:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8009b226-ed8e-5f06-88fd-1423f9addacc with scrape type 2
2026-03-25 22:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8009b226-ed8e-5f06-88fd-1423f9addacc, identifier: 1980281
2026-03-25 22:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-25 22:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281
2026-03-25 22:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8009b226-ed8e-5f06-88fd-1423f9addacc with identifier: 1980281 to the API
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8009b226-ed8e-5f06-88fd-1423f9addacc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 176568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980281%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Saving data for 1980281: {'auction_closing_time': 1774530000.0, 'created_time': 1774392628.337876, 'last_price_update_time': 1774479208.074129}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980281') HTTP/1.1" 204 0
2026-03-25 22:53:28 [ayvens.be] INFO: Found listing with ID: 1980282
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980282%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Scrape type for 1980282: 2
2026-03-25 22:53:28 [ayvens.be] INFO: Extracting data for car ID: 1980282
2026-03-25 22:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-25 22:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 2
2026-03-25 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98af7d6-f024-5aa3-97ef-40e680410d5e with scrape type 2
2026-03-25 22:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b98af7d6-f024-5aa3-97ef-40e680410d5e, identifier: 1980282
2026-03-25 22:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-25 22:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282
2026-03-25 22:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b98af7d6-f024-5aa3-97ef-40e680410d5e with identifier: 1980282 to the API
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b98af7d6-f024-5aa3-97ef-40e680410d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980282%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Saving data for 1980282: {'auction_closing_time': 1774530000.0, 'created_time': 1774392629.16545, 'last_price_update_time': 1774479208.567552}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980282') HTTP/1.1" 204 0
2026-03-25 22:53:28 [ayvens.be] INFO: Found listing with ID: 1980283
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980283%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Scrape type for 1980283: 2
2026-03-25 22:53:28 [ayvens.be] INFO: Extracting data for car ID: 1980283
2026-03-25 22:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-25 22:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d868b1-3833-5891-888d-2c7a0bcc8d68 with scrape type 2
2026-03-25 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6d868b1-3833-5891-888d-2c7a0bcc8d68 with scrape type 2
2026-03-25 22:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6d868b1-3833-5891-888d-2c7a0bcc8d68, identifier: 1980283
2026-03-25 22:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-25 22:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283
2026-03-25 22:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6d868b1-3833-5891-888d-2c7a0bcc8d68 with identifier: 1980283 to the API
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'c6d868b1-3833-5891-888d-2c7a0bcc8d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 59250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE ULTIMATE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980283%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Saving data for 1980283: {'auction_closing_time': 1774530000.0, 'created_time': 1774392630.665509, 'last_price_update_time': 1774479208.960611}
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980283') HTTP/1.1" 204 0
2026-03-25 22:53:28 [ayvens.be] INFO: Found listing with ID: 1980284
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980284%27 HTTP/1.1" 200 None
2026-03-25 22:53:28 [ayvens.be] INFO: Scrape type for 1980284: 2
2026-03-25 22:53:28 [ayvens.be] INFO: Extracting data for car ID: 1980284
2026-03-25 22:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-25 22:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72602aec-d0d8-576b-b164-e468add0d3bc with scrape type 2
2026-03-25 22:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72602aec-d0d8-576b-b164-e468add0d3bc with scrape type 2
2026-03-25 22:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 72602aec-d0d8-576b-b164-e468add0d3bc, identifier: 1980284
2026-03-25 22:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-25 22:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284
2026-03-25 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 72602aec-d0d8-576b-b164-e468add0d3bc with identifier: 1980284 to the API
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '72602aec-d0d8-576b-b164-e468add0d3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 57078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980284%27 HTTP/1.1" 200 None
2026-03-25 22:53:29 [ayvens.be] INFO: Saving data for 1980284: {'auction_closing_time': 1774530000.0, 'created_time': 1774392632.207865, 'last_price_update_time': 1774479209.332221}
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980284') HTTP/1.1" 204 0
2026-03-25 22:53:29 [ayvens.be] INFO: Found listing with ID: 1980285
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980285%27 HTTP/1.1" 200 None
2026-03-25 22:53:29 [ayvens.be] INFO: Scrape type for 1980285: 2
2026-03-25 22:53:29 [ayvens.be] INFO: Extracting data for car ID: 1980285
2026-03-25 22:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-25 22:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 2
2026-03-25 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with scrape type 2
2026-03-25 22:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9, identifier: 1980285
2026-03-25 22:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-25 22:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285
2026-03-25 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4341abc-d20c-5dc4-9c41-96d7b9c25bd9 with identifier: 1980285 to the API
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e4341abc-d20c-5dc4-9c41-96d7b9c25bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 148807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 71KWH EQA 250+ AMG LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH EQA 250+ AMG LINE',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980285%27 HTTP/1.1" 200 None
2026-03-25 22:53:29 [ayvens.be] INFO: Saving data for 1980285: {'auction_closing_time': 1774530000.0, 'created_time': 1774392633.709944, 'last_price_update_time': 1774479209.702106}
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980285') HTTP/1.1" 204 0
2026-03-25 22:53:29 [ayvens.be] INFO: Found listing with ID: 1980286
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980286%27 HTTP/1.1" 200 None
2026-03-25 22:53:29 [ayvens.be] INFO: Scrape type for 1980286: 2
2026-03-25 22:53:29 [ayvens.be] INFO: Extracting data for car ID: 1980286
2026-03-25 22:53:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-25 22:53:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 2
2026-03-25 22:53:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with scrape type 2
2026-03-25 22:53:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b, identifier: 1980286
2026-03-25 22:53:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-25 22:53:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286
2026-03-25 22:53:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e4bf4fcc-1696-5beb-b3eb-da3894a8b24b with identifier: 1980286 to the API
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e4bf4fcc-1696-5beb-b3eb-da3894a8b24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 137222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980286%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Saving data for 1980286: {'auction_closing_time': 1774530000.0, 'created_time': 1774392635.25646, 'last_price_update_time': 1774479210.087749}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980286') HTTP/1.1" 204 0
2026-03-25 22:53:30 [ayvens.be] INFO: Found listing with ID: 1980287
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980287%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Scrape type for 1980287: 2
2026-03-25 22:53:30 [ayvens.be] INFO: Extracting data for car ID: 1980287
2026-03-25 22:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-25 22:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8b13729-051a-5f0f-82ed-76c5c3e0e89b with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8b13729-051a-5f0f-82ed-76c5c3e0e89b, identifier: 1980287
2026-03-25 22:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-25 22:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287
2026-03-25 22:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8b13729-051a-5f0f-82ed-76c5c3e0e89b with identifier: 1980287 to the API
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a8b13729-051a-5f0f-82ed-76c5c3e0e89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 50993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving SchoolrnDouble Pedal',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980287%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Saving data for 1980287: {'auction_closing_time': 1774530000.0, 'created_time': 1774392636.583484, 'last_price_update_time': 1774479210.458535}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980287') HTTP/1.1" 204 0
2026-03-25 22:53:30 [ayvens.be] INFO: Found listing with ID: 1980288
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980288%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Scrape type for 1980288: 2
2026-03-25 22:53:30 [ayvens.be] INFO: Extracting data for car ID: 1980288
2026-03-25 22:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-25 22:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee1d7014-c475-5bb9-87c3-772c3e34a011 with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ee1d7014-c475-5bb9-87c3-772c3e34a011, identifier: 1980288
2026-03-25 22:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-25 22:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288
2026-03-25 22:53:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ee1d7014-c475-5bb9-87c3-772c3e34a011 with identifier: 1980288 to the API
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee1d7014-c475-5bb9-87c3-772c3e34a011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 58479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.2 81KW TURBO S-S GS  Driving School    Double '
          'Pedal',
 'transmission': 'manual',
 'trim': '1.2 81KW TURBO S-S GS  Driving School    Double Pedal',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980288%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Saving data for 1980288: {'auction_closing_time': 1774530000.0, 'created_time': 1774392637.928144, 'last_price_update_time': 1774479210.833937}
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980288') HTTP/1.1" 204 0
2026-03-25 22:53:30 [ayvens.be] INFO: Found listing with ID: 1980289
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980289%27 HTTP/1.1" 200 None
2026-03-25 22:53:30 [ayvens.be] INFO: Scrape type for 1980289: 2
2026-03-25 22:53:30 [ayvens.be] INFO: Extracting data for car ID: 1980289
2026-03-25 22:53:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-25 22:53:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dddc1730-e2f6-59ba-acb6-05479044fc6d with scrape type 2
2026-03-25 22:53:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dddc1730-e2f6-59ba-acb6-05479044fc6d, identifier: 1980289
2026-03-25 22:53:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-25 22:53:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289
2026-03-25 22:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dddc1730-e2f6-59ba-acb6-05479044fc6d with identifier: 1980289 to the API
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dddc1730-e2f6-59ba-acb6-05479044fc6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 54057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980289%27 HTTP/1.1" 200 None
2026-03-25 22:53:31 [ayvens.be] INFO: Saving data for 1980289: {'auction_closing_time': 1774530000.0, 'created_time': 1774392639.36154, 'last_price_update_time': 1774479211.66397}
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980289') HTTP/1.1" 204 0
2026-03-25 22:53:31 [ayvens.be] INFO: Found listing with ID: 1980290
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980290%27 HTTP/1.1" 200 None
2026-03-25 22:53:31 [ayvens.be] INFO: Scrape type for 1980290: 2
2026-03-25 22:53:31 [ayvens.be] INFO: Extracting data for car ID: 1980290
2026-03-25 22:53:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-25 22:53:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 2
2026-03-25 22:53:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d88768-9bf6-5f29-90de-1b51ec377c95 with scrape type 2
2026-03-25 22:53:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7d88768-9bf6-5f29-90de-1b51ec377c95, identifier: 1980290
2026-03-25 22:53:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-25 22:53:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290
2026-03-25 22:53:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7d88768-9bf6-5f29-90de-1b51ec377c95 with identifier: 1980290 to the API
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'b7d88768-9bf6-5f29-90de-1b51ec377c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 77898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 71KWH 50 QUATTRO S-LINE',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH 50 QUATTRO S-LINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980290%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Saving data for 1980290: {'auction_closing_time': 1774530000.0, 'created_time': 1774392640.787156, 'last_price_update_time': 1774479212.05382}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980290') HTTP/1.1" 204 0
2026-03-25 22:53:32 [ayvens.be] INFO: Found listing with ID: 1980291
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980291%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Scrape type for 1980291: 2
2026-03-25 22:53:32 [ayvens.be] INFO: Extracting data for car ID: 1980291
2026-03-25 22:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-25 22:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 2
2026-03-25 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2dfeb37-a687-5958-9f0b-f61b0318d841 with scrape type 2
2026-03-25 22:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d2dfeb37-a687-5958-9f0b-f61b0318d841, identifier: 1980291
2026-03-25 22:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-25 22:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291
2026-03-25 22:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d2dfeb37-a687-5958-9f0b-f61b0318d841 with identifier: 1980291 to the API
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd2dfeb37-a687-5958-9f0b-f61b0318d841',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 89510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS LINE DCT SH BR',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980291%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Saving data for 1980291: {'auction_closing_time': 1774530000.0, 'created_time': 1774392642.301623, 'last_price_update_time': 1774479212.434236}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980291') HTTP/1.1" 204 0
2026-03-25 22:53:32 [ayvens.be] INFO: Found listing with ID: 1980292
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980292%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Scrape type for 1980292: 2
2026-03-25 22:53:32 [ayvens.be] INFO: Extracting data for car ID: 1980292
2026-03-25 22:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-25 22:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd75f594-b3c6-5c35-bca6-b8f604790c03 with scrape type 2
2026-03-25 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd75f594-b3c6-5c35-bca6-b8f604790c03 with scrape type 2
2026-03-25 22:53:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fd75f594-b3c6-5c35-bca6-b8f604790c03, identifier: 1980292
2026-03-25 22:53:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-25 22:53:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292
2026-03-25 22:53:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fd75f594-b3c6-5c35-bca6-b8f604790c03 with identifier: 1980292 to the API
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fd75f594-b3c6-5c35-bca6-b8f604790c03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 80299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980292%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Saving data for 1980292: {'auction_closing_time': 1774530000.0, 'created_time': 1774392643.693727, 'last_price_update_time': 1774479212.812928}
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980292') HTTP/1.1" 204 0
2026-03-25 22:53:32 [ayvens.be] INFO: Found listing with ID: 1980293
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980293%27 HTTP/1.1" 200 None
2026-03-25 22:53:32 [ayvens.be] INFO: Scrape type for 1980293: 2
2026-03-25 22:53:32 [ayvens.be] INFO: Extracting data for car ID: 1980293
2026-03-25 22:53:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-25 22:53:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 2
2026-03-25 22:53:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01115e5d-60ff-5dfb-bc55-79d8d479682e with scrape type 2
2026-03-25 22:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01115e5d-60ff-5dfb-bc55-79d8d479682e, identifier: 1980293
2026-03-25 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-25 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293
2026-03-25 22:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 01115e5d-60ff-5dfb-bc55-79d8d479682e with identifier: 1980293 to the API
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'CAVANSITE BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '01115e5d-60ff-5dfb-bc55-79d8d479682e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 215432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980293%27 HTTP/1.1" 200 None
2026-03-25 22:53:33 [ayvens.be] INFO: Saving data for 1980293: {'auction_closing_time': 1774530000.0, 'created_time': 1774392645.885804, 'last_price_update_time': 1774479213.303216}
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980293') HTTP/1.1" 204 0
2026-03-25 22:53:33 [ayvens.be] INFO: Found listing with ID: 1980294
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980294%27 HTTP/1.1" 200 None
2026-03-25 22:53:33 [ayvens.be] INFO: Scrape type for 1980294: 2
2026-03-25 22:53:33 [ayvens.be] INFO: Extracting data for car ID: 1980294
2026-03-25 22:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-25 22:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 2
2026-03-25 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d66e48-2f7e-53b5-a957-8c3f93250b6e with scrape type 2
2026-03-25 22:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06d66e48-2f7e-53b5-a957-8c3f93250b6e, identifier: 1980294
2026-03-25 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-25 22:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294
2026-03-25 22:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 06d66e48-2f7e-53b5-a957-8c3f93250b6e with identifier: 1980294 to the API
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 10835175,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '06d66e48-2f7e-53b5-a957-8c3f93250b6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 35175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980294%27 HTTP/1.1" 200 None
2026-03-25 22:53:33 [ayvens.be] INFO: Saving data for 1980294: {'auction_closing_time': 1774530000.0, 'created_time': 1774392647.265752, 'last_price_update_time': 1774479213.673893}
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980294') HTTP/1.1" 204 0
2026-03-25 22:53:33 [ayvens.be] INFO: Found listing with ID: 1980295
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980295%27 HTTP/1.1" 200 None
2026-03-25 22:53:33 [ayvens.be] INFO: Scrape type for 1980295: 2
2026-03-25 22:53:33 [ayvens.be] INFO: Extracting data for car ID: 1980295
2026-03-25 22:53:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-25 22:53:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 2
2026-03-25 22:53:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d54a7ee4-2d8b-566b-a509-c22bcb737f83 with scrape type 2
2026-03-25 22:53:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d54a7ee4-2d8b-566b-a509-c22bcb737f83, identifier: 1980295
2026-03-25 22:53:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-25 22:53:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295
2026-03-25 22:53:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d54a7ee4-2d8b-566b-a509-c22bcb737f83 with identifier: 1980295 to the API
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd54a7ee4-2d8b-566b-a509-c22bcb737f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 94918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980295%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Saving data for 1980295: {'auction_closing_time': 1774530000.0, 'created_time': 1774392648.45066, 'last_price_update_time': 1774479214.051622}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980295') HTTP/1.1" 204 0
2026-03-25 22:53:34 [ayvens.be] INFO: Found listing with ID: 1980296
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980296%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Scrape type for 1980296: 2
2026-03-25 22:53:34 [ayvens.be] INFO: Extracting data for car ID: 1980296
2026-03-25 22:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-25 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faea3369-91d8-5b91-a94c-ab1ee56c2f75 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: faea3369-91d8-5b91-a94c-ab1ee56c2f75, identifier: 1980296
2026-03-25 22:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-25 22:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296
2026-03-25 22:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: faea3369-91d8-5b91-a94c-ab1ee56c2f75 with identifier: 1980296 to the API
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'faea3369-91d8-5b91-a94c-ab1ee56c2f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 85359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980296%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Saving data for 1980296: {'auction_closing_time': 1774530000.0, 'created_time': 1774392650.269312, 'last_price_update_time': 1774479214.425214}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980296') HTTP/1.1" 204 0
2026-03-25 22:53:34 [ayvens.be] INFO: Found listing with ID: 1980297
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980297%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Scrape type for 1980297: 2
2026-03-25 22:53:34 [ayvens.be] INFO: Extracting data for car ID: 1980297
2026-03-25 22:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-25 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66, identifier: 1980297
2026-03-25 22:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-25 22:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297
2026-03-25 22:53:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c729140a-a6ea-5cdb-874c-9d2dbfa6cd66 with identifier: 1980297 to the API
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c729140a-a6ea-5cdb-874c-9d2dbfa6cd66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 150408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980297%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Saving data for 1980297: {'auction_closing_time': 1774530000.0, 'created_time': 1774392651.599437, 'last_price_update_time': 1774479214.797028}
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980297') HTTP/1.1" 204 0
2026-03-25 22:53:34 [ayvens.be] INFO: Found listing with ID: 1980298
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980298%27 HTTP/1.1" 200 None
2026-03-25 22:53:34 [ayvens.be] INFO: Scrape type for 1980298: 2
2026-03-25 22:53:34 [ayvens.be] INFO: Extracting data for car ID: 1980298
2026-03-25 22:53:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-25 22:53:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b232f238-ff97-549b-a6d4-bacd62f8dff8 with scrape type 2
2026-03-25 22:53:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b232f238-ff97-549b-a6d4-bacd62f8dff8, identifier: 1980298
2026-03-25 22:53:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-25 22:53:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298
2026-03-25 22:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b232f238-ff97-549b-a6d4-bacd62f8dff8 with identifier: 1980298 to the API
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b232f238-ff97-549b-a6d4-bacd62f8dff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 154342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980298%27 HTTP/1.1" 200 None
2026-03-25 22:53:35 [ayvens.be] INFO: Saving data for 1980298: {'auction_closing_time': 1774530000.0, 'created_time': 1774392653.376916, 'last_price_update_time': 1774479215.204108}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980298') HTTP/1.1" 204 0
2026-03-25 22:53:35 [ayvens.be] INFO: Found listing with ID: 1980299
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980299%27 HTTP/1.1" 200 None
2026-03-25 22:53:35 [ayvens.be] INFO: Scrape type for 1980299: 2
2026-03-25 22:53:35 [ayvens.be] INFO: Extracting data for car ID: 1980299
2026-03-25 22:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-25 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f27df9-0592-58bd-bbc2-2af169486214 with scrape type 2
2026-03-25 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f27df9-0592-58bd-bbc2-2af169486214 with scrape type 2
2026-03-25 22:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3f27df9-0592-58bd-bbc2-2af169486214, identifier: 1980299
2026-03-25 22:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-25 22:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299
2026-03-25 22:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3f27df9-0592-58bd-bbc2-2af169486214 with identifier: 1980299 to the API
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a3f27df9-0592-58bd-bbc2-2af169486214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 163774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980299%27 HTTP/1.1" 200 None
2026-03-25 22:53:35 [ayvens.be] INFO: Saving data for 1980299: {'auction_closing_time': 1774530000.0, 'created_time': 1774392655.694483, 'last_price_update_time': 1774479215.588885}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980299') HTTP/1.1" 204 0
2026-03-25 22:53:35 [ayvens.be] INFO: Found listing with ID: 1980300
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980300%27 HTTP/1.1" 200 None
2026-03-25 22:53:35 [ayvens.be] INFO: Scrape type for 1980300: 2
2026-03-25 22:53:35 [ayvens.be] INFO: Extracting data for car ID: 1980300
2026-03-25 22:53:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-25 22:53:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 2
2026-03-25 22:53:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 221e3902-9489-55a3-aab9-96890baab06c with scrape type 2
2026-03-25 22:53:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 221e3902-9489-55a3-aab9-96890baab06c, identifier: 1980300
2026-03-25 22:53:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-25 22:53:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300
2026-03-25 22:53:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 221e3902-9489-55a3-aab9-96890baab06c with identifier: 1980300 to the API
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '221e3902-9489-55a3-aab9-96890baab06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 101350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 1.0 TFSI 30 81KW ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 TFSI 30 81KW ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980300%27 HTTP/1.1" 200 None
2026-03-25 22:53:35 [ayvens.be] INFO: Saving data for 1980300: {'auction_closing_time': 1774530000.0, 'created_time': 1774392657.7435, 'last_price_update_time': 1774479215.972784}
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980300') HTTP/1.1" 204 0
2026-03-25 22:53:35 [ayvens.be] INFO: Found listing with ID: 1980301
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980301%27 HTTP/1.1" 200 None
2026-03-25 22:53:36 [ayvens.be] INFO: Scrape type for 1980301: 2
2026-03-25 22:53:36 [ayvens.be] INFO: Extracting data for car ID: 1980301
2026-03-25 22:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-25 22:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf, identifier: 1980301
2026-03-25 22:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-25 22:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301
2026-03-25 22:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5e0caed5-1fb6-58fb-a2e6-65e6018b09cf with identifier: 1980301 to the API
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '5e0caed5-1fb6-58fb-a2e6-65e6018b09cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 121863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5iA xDrive25e PHEV OPF',
 'transmission': 'automatic',
 'trim': '1.5iA xDrive25e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980301%27 HTTP/1.1" 200 None
2026-03-25 22:53:36 [ayvens.be] INFO: Saving data for 1980301: {'auction_closing_time': 1774530000.0, 'created_time': 1774392659.201921, 'last_price_update_time': 1774479216.389345}
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980301') HTTP/1.1" 204 0
2026-03-25 22:53:36 [ayvens.be] INFO: Found listing with ID: 1980302
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980302%27 HTTP/1.1" 200 None
2026-03-25 22:53:36 [ayvens.be] INFO: Scrape type for 1980302: 2
2026-03-25 22:53:36 [ayvens.be] INFO: Extracting data for car ID: 1980302
2026-03-25 22:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-25 22:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8897836b-5393-5b54-b0d9-9b410fbd8588 with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8897836b-5393-5b54-b0d9-9b410fbd8588, identifier: 1980302
2026-03-25 22:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-25 22:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302
2026-03-25 22:53:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8897836b-5393-5b54-b0d9-9b410fbd8588 with identifier: 1980302 to the API
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8897836b-5393-5b54-b0d9-9b410fbd8588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 101953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980302%27 HTTP/1.1" 200 None
2026-03-25 22:53:36 [ayvens.be] INFO: Saving data for 1980302: {'auction_closing_time': 1774530000.0, 'created_time': 1774392660.628051, 'last_price_update_time': 1774479216.78998}
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980302') HTTP/1.1" 204 0
2026-03-25 22:53:36 [ayvens.be] INFO: Found listing with ID: 1980303
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980303%27 HTTP/1.1" 200 None
2026-03-25 22:53:36 [ayvens.be] INFO: Scrape type for 1980303: 2
2026-03-25 22:53:36 [ayvens.be] INFO: Extracting data for car ID: 1980303
2026-03-25 22:53:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-25 22:53:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86c029b-7f83-5f8f-b81d-a7e0e4164053 with scrape type 2
2026-03-25 22:53:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a86c029b-7f83-5f8f-b81d-a7e0e4164053, identifier: 1980303
2026-03-25 22:53:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-25 22:53:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303
2026-03-25 22:53:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a86c029b-7f83-5f8f-b81d-a7e0e4164053 with identifier: 1980303 to the API
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a86c029b-7f83-5f8f-b81d-a7e0e4164053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 93071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980303%27 HTTP/1.1" 200 None
2026-03-25 22:53:37 [ayvens.be] INFO: Saving data for 1980303: {'auction_closing_time': 1774530000.0, 'created_time': 1774392662.1543, 'last_price_update_time': 1774479217.166189}
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980303') HTTP/1.1" 204 0
2026-03-25 22:53:37 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-03-25 22:53:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:53:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:53:39 [ayvens.be] INFO: Found listing with ID: 1980304
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980304%27 HTTP/1.1" 200 None
2026-03-25 22:53:39 [ayvens.be] INFO: Scrape type for 1980304: 2
2026-03-25 22:53:39 [ayvens.be] INFO: Extracting data for car ID: 1980304
2026-03-25 22:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-25 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 2
2026-03-25 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7320108-93e1-5815-b2ae-f9adc20ddb67 with scrape type 2
2026-03-25 22:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a7320108-93e1-5815-b2ae-f9adc20ddb67, identifier: 1980304
2026-03-25 22:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-25 22:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304
2026-03-25 22:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a7320108-93e1-5815-b2ae-f9adc20ddb67 with identifier: 1980304 to the API
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a7320108-93e1-5815-b2ae-f9adc20ddb67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 117996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980304%27 HTTP/1.1" 200 None
2026-03-25 22:53:39 [ayvens.be] INFO: Saving data for 1980304: {'auction_closing_time': 1774530000.0, 'created_time': 1774392663.447879, 'last_price_update_time': 1774479219.733543}
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980304') HTTP/1.1" 204 0
2026-03-25 22:53:39 [ayvens.be] INFO: Found listing with ID: 1980305
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980305%27 HTTP/1.1" 200 None
2026-03-25 22:53:39 [ayvens.be] INFO: Scrape type for 1980305: 2
2026-03-25 22:53:39 [ayvens.be] INFO: Extracting data for car ID: 1980305
2026-03-25 22:53:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-25 22:53:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 2
2026-03-25 22:53:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7a90720-4e95-5ec8-a958-7d17809d3896 with scrape type 2
2026-03-25 22:53:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7a90720-4e95-5ec8-a958-7d17809d3896, identifier: 1980305
2026-03-25 22:53:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-25 22:53:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305
2026-03-25 22:53:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7a90720-4e95-5ec8-a958-7d17809d3896 with identifier: 1980305 to the API
2026-03-25 22:53:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7a90720-4e95-5ec8-a958-7d17809d3896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 95871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980305%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Saving data for 1980305: {'auction_closing_time': 1774530000.0, 'created_time': 1774392665.250872, 'last_price_update_time': 1774479220.165566}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980305') HTTP/1.1" 204 0
2026-03-25 22:53:40 [ayvens.be] INFO: Found listing with ID: 1980306
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980306%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Scrape type for 1980306: 2
2026-03-25 22:53:40 [ayvens.be] INFO: Extracting data for car ID: 1980306
2026-03-25 22:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-25 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 2
2026-03-25 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3824f0f-7f9e-5c51-b42c-79ea05c8283e with scrape type 2
2026-03-25 22:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3824f0f-7f9e-5c51-b42c-79ea05c8283e, identifier: 1980306
2026-03-25 22:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-25 22:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306
2026-03-25 22:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3824f0f-7f9e-5c51-b42c-79ea05c8283e with identifier: 1980306 to the API
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd3824f0f-7f9e-5c51-b42c-79ea05c8283e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 60223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980306%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Saving data for 1980306: {'auction_closing_time': 1774530000.0, 'created_time': 1774392668.735744, 'last_price_update_time': 1774479220.542372}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980306') HTTP/1.1" 204 0
2026-03-25 22:53:40 [ayvens.be] INFO: Found listing with ID: 1980307
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980307%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Scrape type for 1980307: 2
2026-03-25 22:53:40 [ayvens.be] INFO: Extracting data for car ID: 1980307
2026-03-25 22:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-25 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 2
2026-03-25 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3523fb47-4378-50b8-98c0-ddf9b02d04ec with scrape type 2
2026-03-25 22:53:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3523fb47-4378-50b8-98c0-ddf9b02d04ec, identifier: 1980307
2026-03-25 22:53:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-25 22:53:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307
2026-03-25 22:53:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3523fb47-4378-50b8-98c0-ddf9b02d04ec with identifier: 1980307 to the API
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3523fb47-4378-50b8-98c0-ddf9b02d04ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 93484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320E BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 320E BERLINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980307%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Saving data for 1980307: {'auction_closing_time': 1774530000.0, 'created_time': 1774392670.730977, 'last_price_update_time': 1774479220.936338}
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980307') HTTP/1.1" 204 0
2026-03-25 22:53:40 [ayvens.be] INFO: Found listing with ID: 1980308
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980308%27 HTTP/1.1" 200 None
2026-03-25 22:53:40 [ayvens.be] INFO: Scrape type for 1980308: 2
2026-03-25 22:53:40 [ayvens.be] INFO: Extracting data for car ID: 1980308
2026-03-25 22:53:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-25 22:53:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 2
2026-03-25 22:53:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with scrape type 2
2026-03-25 22:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17, identifier: 1980308
2026-03-25 22:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-25 22:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308
2026-03-25 22:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a2b7706-9cb9-50f9-bf45-1d72b1675d17 with identifier: 1980308 to the API
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3a2b7706-9cb9-50f9-bf45-1d72b1675d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 61319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 81KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980308%27 HTTP/1.1" 200 None
2026-03-25 22:53:41 [ayvens.be] INFO: Saving data for 1980308: {'auction_closing_time': 1774530000.0, 'created_time': 1774392672.724936, 'last_price_update_time': 1774479221.3247}
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980308') HTTP/1.1" 204 0
2026-03-25 22:53:41 [ayvens.be] INFO: Found listing with ID: 1980309
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980309%27 HTTP/1.1" 200 None
2026-03-25 22:53:41 [ayvens.be] INFO: Scrape type for 1980309: 2
2026-03-25 22:53:41 [ayvens.be] INFO: Extracting data for car ID: 1980309
2026-03-25 22:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-25 22:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 2
2026-03-25 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0475d773-c9bd-57d9-92ba-2afdf730d633 with scrape type 2
2026-03-25 22:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0475d773-c9bd-57d9-92ba-2afdf730d633, identifier: 1980309
2026-03-25 22:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-25 22:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309
2026-03-25 22:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0475d773-c9bd-57d9-92ba-2afdf730d633 with identifier: 1980309 to the API
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0475d773-c9bd-57d9-92ba-2afdf730d633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 89787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980309%27 HTTP/1.1" 200 None
2026-03-25 22:53:41 [ayvens.be] INFO: Saving data for 1980309: {'auction_closing_time': 1774530000.0, 'created_time': 1774392674.173605, 'last_price_update_time': 1774479221.685076}
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980309') HTTP/1.1" 204 0
2026-03-25 22:53:41 [ayvens.be] INFO: Found listing with ID: 1980310
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980310%27 HTTP/1.1" 200 None
2026-03-25 22:53:41 [ayvens.be] INFO: Scrape type for 1980310: 2
2026-03-25 22:53:41 [ayvens.be] INFO: Extracting data for car ID: 1980310
2026-03-25 22:53:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-25 22:53:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 2
2026-03-25 22:53:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32ddf75-f711-5d8e-88f4-e2a8637663cd with scrape type 2
2026-03-25 22:53:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c32ddf75-f711-5d8e-88f4-e2a8637663cd, identifier: 1980310
2026-03-25 22:53:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-25 22:53:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310
2026-03-25 22:53:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c32ddf75-f711-5d8e-88f4-e2a8637663cd with identifier: 1980310 to the API
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c32ddf75-f711-5d8e-88f4-e2a8637663cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 144843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 170KW XDRIVE AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 530E 170KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980310%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Saving data for 1980310: {'auction_closing_time': 1774530000.0, 'created_time': 1774392676.246764, 'last_price_update_time': 1774479222.088887}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980310') HTTP/1.1" 204 0
2026-03-25 22:53:42 [ayvens.be] INFO: Found listing with ID: 1980311
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980311%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Scrape type for 1980311: 2
2026-03-25 22:53:42 [ayvens.be] INFO: Extracting data for car ID: 1980311
2026-03-25 22:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-25 22:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c35c4e19-ff8a-52ec-beab-c502dd7d84cf with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c35c4e19-ff8a-52ec-beab-c502dd7d84cf, identifier: 1980311
2026-03-25 22:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-25 22:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311
2026-03-25 22:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c35c4e19-ff8a-52ec-beab-c502dd7d84cf with identifier: 1980311 to the API
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c35c4e19-ff8a-52ec-beab-c502dd7d84cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 95935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM X',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980311%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Saving data for 1980311: {'auction_closing_time': 1774530000.0, 'created_time': 1774392677.177089, 'last_price_update_time': 1774479222.465014}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980311') HTTP/1.1" 204 0
2026-03-25 22:53:42 [ayvens.be] INFO: Found listing with ID: 1980312
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980312%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Scrape type for 1980312: 2
2026-03-25 22:53:42 [ayvens.be] INFO: Extracting data for car ID: 1980312
2026-03-25 22:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-25 22:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e9e431-e1c0-5822-8d85-cbcc241018e1 with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 11e9e431-e1c0-5822-8d85-cbcc241018e1, identifier: 1980312
2026-03-25 22:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-25 22:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312
2026-03-25 22:53:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 11e9e431-e1c0-5822-8d85-cbcc241018e1 with identifier: 1980312 to the API
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '11e9e431-e1c0-5822-8d85-cbcc241018e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 128654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980312%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Saving data for 1980312: {'auction_closing_time': 1774530000.0, 'created_time': 1774392679.634761, 'last_price_update_time': 1774479222.848704}
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980312') HTTP/1.1" 204 0
2026-03-25 22:53:42 [ayvens.be] INFO: Found listing with ID: 1980313
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980313%27 HTTP/1.1" 200 None
2026-03-25 22:53:42 [ayvens.be] INFO: Scrape type for 1980313: 2
2026-03-25 22:53:42 [ayvens.be] INFO: Extracting data for car ID: 1980313
2026-03-25 22:53:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-25 22:53:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c31d14e-586c-5631-8915-23d5ef030f15 with scrape type 2
2026-03-25 22:53:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c31d14e-586c-5631-8915-23d5ef030f15, identifier: 1980313
2026-03-25 22:53:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-25 22:53:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313
2026-03-25 22:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c31d14e-586c-5631-8915-23d5ef030f15 with identifier: 1980313 to the API
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c31d14e-586c-5631-8915-23d5ef030f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 102982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E XDRIVE TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E XDRIVE TOURING',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980313%27 HTTP/1.1" 200 None
2026-03-25 22:53:43 [ayvens.be] INFO: Saving data for 1980313: {'auction_closing_time': 1774530000.0, 'created_time': 1774392680.385102, 'last_price_update_time': 1774479223.281268}
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980313') HTTP/1.1" 204 0
2026-03-25 22:53:43 [ayvens.be] INFO: Found listing with ID: 1980314
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980314%27 HTTP/1.1" 200 None
2026-03-25 22:53:43 [ayvens.be] INFO: Scrape type for 1980314: 2
2026-03-25 22:53:43 [ayvens.be] INFO: Extracting data for car ID: 1980314
2026-03-25 22:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-25 22:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 2
2026-03-25 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1077883c-b0c1-5767-992f-d0213ab4e1c7 with scrape type 2
2026-03-25 22:53:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1077883c-b0c1-5767-992f-d0213ab4e1c7, identifier: 1980314
2026-03-25 22:53:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-25 22:53:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314
2026-03-25 22:53:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1077883c-b0c1-5767-992f-d0213ab4e1c7 with identifier: 1980314 to the API
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1077883c-b0c1-5767-992f-d0213ab4e1c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 64116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980314%27 HTTP/1.1" 200 None
2026-03-25 22:53:43 [ayvens.be] INFO: Saving data for 1980314: {'auction_closing_time': 1774530000.0, 'created_time': 1774392682.460762, 'last_price_update_time': 1774479223.835173}
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980314') HTTP/1.1" 204 0
2026-03-25 22:53:43 [ayvens.be] INFO: Found listing with ID: 1980315
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980315%27 HTTP/1.1" 200 None
2026-03-25 22:53:43 [ayvens.be] INFO: Scrape type for 1980315: 2
2026-03-25 22:53:43 [ayvens.be] INFO: Extracting data for car ID: 1980315
2026-03-25 22:53:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-25 22:53:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 2
2026-03-25 22:53:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1631eb65-126f-594d-a66e-5f4946f4eb27 with scrape type 2
2026-03-25 22:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1631eb65-126f-594d-a66e-5f4946f4eb27, identifier: 1980315
2026-03-25 22:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-25 22:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315
2026-03-25 22:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1631eb65-126f-594d-a66e-5f4946f4eb27 with identifier: 1980315 to the API
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1631eb65-126f-594d-a66e-5f4946f4eb27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 40862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980315%27 HTTP/1.1" 200 None
2026-03-25 22:53:44 [ayvens.be] INFO: Saving data for 1980315: {'auction_closing_time': 1774530000.0, 'created_time': 1774392683.54334, 'last_price_update_time': 1774479224.311668}
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980315') HTTP/1.1" 204 0
2026-03-25 22:53:44 [ayvens.be] INFO: Found listing with ID: 1980316
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980316%27 HTTP/1.1" 200 None
2026-03-25 22:53:44 [ayvens.be] INFO: Scrape type for 1980316: 2
2026-03-25 22:53:44 [ayvens.be] INFO: Extracting data for car ID: 1980316
2026-03-25 22:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-25 22:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 2
2026-03-25 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with scrape type 2
2026-03-25 22:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4d21a3c6-1f65-5cd1-b250-9745fef5b789, identifier: 1980316
2026-03-25 22:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-25 22:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316
2026-03-25 22:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4d21a3c6-1f65-5cd1-b250-9745fef5b789 with identifier: 1980316 to the API
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4d21a3c6-1f65-5cd1-b250-9745fef5b789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 192617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980316%27 HTTP/1.1" 200 None
2026-03-25 22:53:44 [ayvens.be] INFO: Saving data for 1980316: {'auction_closing_time': 1774530000.0, 'created_time': 1774392685.498003, 'last_price_update_time': 1774479224.713478}
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980316') HTTP/1.1" 204 0
2026-03-25 22:53:44 [ayvens.be] INFO: Found listing with ID: 1980317
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980317%27 HTTP/1.1" 200 None
2026-03-25 22:53:44 [ayvens.be] INFO: Scrape type for 1980317: 2
2026-03-25 22:53:44 [ayvens.be] INFO: Extracting data for car ID: 1980317
2026-03-25 22:53:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-25 22:53:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 2
2026-03-25 22:53:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with scrape type 2
2026-03-25 22:53:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c, identifier: 1980317
2026-03-25 22:53:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-25 22:53:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317
2026-03-25 22:53:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55de8cbe-2247-5b6f-b8d2-39ad91e6d17c with identifier: 1980317 to the API
2026-03-25 22:53:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '55de8cbe-2247-5b6f-b8d2-39ad91e6d17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 40253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 EQUILIBRE',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EQUILIBRE',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980317%27 HTTP/1.1" 200 None
2026-03-25 22:53:45 [ayvens.be] INFO: Saving data for 1980317: {'auction_closing_time': 1774530000.0, 'created_time': 1774392716.028491, 'last_price_update_time': 1774479225.125132}
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980317') HTTP/1.1" 204 0
2026-03-25 22:53:45 [ayvens.be] INFO: Found listing with ID: 1980318
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980318%27 HTTP/1.1" 200 None
2026-03-25 22:53:45 [ayvens.be] INFO: Scrape type for 1980318: 2
2026-03-25 22:53:45 [ayvens.be] INFO: Extracting data for car ID: 1980318
2026-03-25 22:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-25 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 2
2026-03-25 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with scrape type 2
2026-03-25 22:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb, identifier: 1980318
2026-03-25 22:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-25 22:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318
2026-03-25 22:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 27122ce6-6efb-57c3-8ae6-24b13bc4abdb with identifier: 1980318 to the API
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '27122ce6-6efb-57c3-8ae6-24b13bc4abdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS',
 'odometer': 81085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS 1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-EAT8 SHINE AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980318%27 HTTP/1.1" 200 None
2026-03-25 22:53:45 [ayvens.be] INFO: Saving data for 1980318: {'auction_closing_time': 1774530000.0, 'created_time': 1774392688.318922, 'last_price_update_time': 1774479225.505443}
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980318') HTTP/1.1" 204 0
2026-03-25 22:53:45 [ayvens.be] INFO: Found listing with ID: 1980319
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980319%27 HTTP/1.1" 200 None
2026-03-25 22:53:45 [ayvens.be] INFO: Scrape type for 1980319: 2
2026-03-25 22:53:45 [ayvens.be] INFO: Extracting data for car ID: 1980319
2026-03-25 22:53:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-25 22:53:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 2
2026-03-25 22:53:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c2d1c4-9322-5908-a639-1d2425340280 with scrape type 2
2026-03-25 22:53:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2c2d1c4-9322-5908-a639-1d2425340280, identifier: 1980319
2026-03-25 22:53:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-25 22:53:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319
2026-03-25 22:53:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2c2d1c4-9322-5908-a639-1d2425340280 with identifier: 1980319 to the API
2026-03-25 22:53:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2c2d1c4-9322-5908-a639-1d2425340280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 120060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '2.0 GLB 200 D LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980319%27 HTTP/1.1" 200 None
2026-03-25 22:53:46 [ayvens.be] INFO: Saving data for 1980319: {'auction_closing_time': 1774530000.0, 'created_time': 1774392689.540355, 'last_price_update_time': 1774479226.361319}
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980319') HTTP/1.1" 204 0
2026-03-25 22:53:46 [ayvens.be] INFO: Found listing with ID: 1980320
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980320%27 HTTP/1.1" 200 None
2026-03-25 22:53:46 [ayvens.be] INFO: Scrape type for 1980320: 2
2026-03-25 22:53:46 [ayvens.be] INFO: Extracting data for car ID: 1980320
2026-03-25 22:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-25 22:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 2
2026-03-25 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ac458c-7145-517c-9805-468b8545bc8f with scrape type 2
2026-03-25 22:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7ac458c-7145-517c-9805-468b8545bc8f, identifier: 1980320
2026-03-25 22:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-25 22:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320
2026-03-25 22:53:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e7ac458c-7145-517c-9805-468b8545bc8f with identifier: 1980320 to the API
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7ac458c-7145-517c-9805-468b8545bc8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 131721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980320%27 HTTP/1.1" 200 None
2026-03-25 22:53:46 [ayvens.be] INFO: Saving data for 1980320: {'auction_closing_time': 1774530000.0, 'created_time': 1774392691.784624, 'last_price_update_time': 1774479226.785473}
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980320') HTTP/1.1" 204 0
2026-03-25 22:53:46 [ayvens.be] INFO: Found listing with ID: 1980321
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980321%27 HTTP/1.1" 200 None
2026-03-25 22:53:46 [ayvens.be] INFO: Scrape type for 1980321: 2
2026-03-25 22:53:46 [ayvens.be] INFO: Extracting data for car ID: 1980321
2026-03-25 22:53:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-25 22:53:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 2
2026-03-25 22:53:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fee27e6-61f1-5f95-91d9-a32647513628 with scrape type 2
2026-03-25 22:53:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3fee27e6-61f1-5f95-91d9-a32647513628, identifier: 1980321
2026-03-25 22:53:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-25 22:53:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321
2026-03-25 22:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3fee27e6-61f1-5f95-91d9-a32647513628 with identifier: 1980321 to the API
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fee27e6-61f1-5f95-91d9-a32647513628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 156563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980321%27 HTTP/1.1" 200 None
2026-03-25 22:53:47 [ayvens.be] INFO: Saving data for 1980321: {'auction_closing_time': 1774530000.0, 'created_time': 1774392692.661417, 'last_price_update_time': 1774479227.193085}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980321') HTTP/1.1" 204 0
2026-03-25 22:53:47 [ayvens.be] INFO: Found listing with ID: 1980322
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980322%27 HTTP/1.1" 200 None
2026-03-25 22:53:47 [ayvens.be] INFO: Scrape type for 1980322: 2
2026-03-25 22:53:47 [ayvens.be] INFO: Extracting data for car ID: 1980322
2026-03-25 22:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-25 22:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 2
2026-03-25 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477eb99e-c090-55db-89eb-5a7bf472e898 with scrape type 2
2026-03-25 22:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 477eb99e-c090-55db-89eb-5a7bf472e898, identifier: 1980322
2026-03-25 22:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-25 22:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322
2026-03-25 22:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 477eb99e-c090-55db-89eb-5a7bf472e898 with identifier: 1980322 to the API
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '477eb99e-c090-55db-89eb-5a7bf472e898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 46187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO 4MT',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980322%27 HTTP/1.1" 200 None
2026-03-25 22:53:47 [ayvens.be] INFO: Saving data for 1980322: {'auction_closing_time': 1774530000.0, 'created_time': 1774392694.617107, 'last_price_update_time': 1774479227.599012}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980322') HTTP/1.1" 204 0
2026-03-25 22:53:47 [ayvens.be] INFO: Found listing with ID: 1980323
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980323%27 HTTP/1.1" 200 None
2026-03-25 22:53:47 [ayvens.be] INFO: Scrape type for 1980323: 2
2026-03-25 22:53:47 [ayvens.be] INFO: Extracting data for car ID: 1980323
2026-03-25 22:53:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-25 22:53:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 2
2026-03-25 22:53:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 586037ca-bf37-5f2f-8942-f775bf132317 with scrape type 2
2026-03-25 22:53:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 586037ca-bf37-5f2f-8942-f775bf132317, identifier: 1980323
2026-03-25 22:53:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-25 22:53:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323
2026-03-25 22:53:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 586037ca-bf37-5f2f-8942-f775bf132317 with identifier: 1980323 to the API
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '586037ca-bf37-5f2f-8942-f775bf132317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 75116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 d AdBlue',
 'transmission': 'manual',
 'trim': '216 d AdBlue',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980323%27 HTTP/1.1" 200 None
2026-03-25 22:53:47 [ayvens.be] INFO: Saving data for 1980323: {'auction_closing_time': 1774530000.0, 'created_time': 1774392695.833418, 'last_price_update_time': 1774479227.984352}
2026-03-25 22:53:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980323') HTTP/1.1" 204 0
2026-03-25 22:53:48 [ayvens.be] INFO: Found listing with ID: 1980324
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980324%27 HTTP/1.1" 200 None
2026-03-25 22:53:48 [ayvens.be] INFO: Scrape type for 1980324: 2
2026-03-25 22:53:48 [ayvens.be] INFO: Extracting data for car ID: 1980324
2026-03-25 22:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-25 22:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15129c96-225f-52ab-943d-69e5fbd62080 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15129c96-225f-52ab-943d-69e5fbd62080, identifier: 1980324
2026-03-25 22:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-25 22:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324
2026-03-25 22:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15129c96-225f-52ab-943d-69e5fbd62080 with identifier: 1980324 to the API
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '15129c96-225f-52ab-943d-69e5fbd62080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW DIESEL - 2018',
 'odometer': 72664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW DIESEL - 2018 1.5 BlueHDi Active S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Active S&S',
 'vin': None,
 'year': 2020}
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980324%27 HTTP/1.1" 200 None
2026-03-25 22:53:48 [ayvens.be] INFO: Saving data for 1980324: {'auction_closing_time': 1774530000.0, 'created_time': 1774392696.892223, 'last_price_update_time': 1774479228.378367}
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980324') HTTP/1.1" 204 0
2026-03-25 22:53:48 [ayvens.be] INFO: Found listing with ID: 1980325
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980325%27 HTTP/1.1" 200 None
2026-03-25 22:53:48 [ayvens.be] INFO: Scrape type for 1980325: 2
2026-03-25 22:53:48 [ayvens.be] INFO: Extracting data for car ID: 1980325
2026-03-25 22:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-25 22:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a931999a-c1a0-5ac7-a643-391330f16773 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a931999a-c1a0-5ac7-a643-391330f16773, identifier: 1980325
2026-03-25 22:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-25 22:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325
2026-03-25 22:53:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a931999a-c1a0-5ac7-a643-391330f16773 with identifier: 1980325 to the API
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a931999a-c1a0-5ac7-a643-391330f16773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 60665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH ELECT. E-208 AUTO ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980325%27 HTTP/1.1" 200 None
2026-03-25 22:53:48 [ayvens.be] INFO: Saving data for 1980325: {'auction_closing_time': 1774530000.0, 'created_time': 1774392698.432893, 'last_price_update_time': 1774479228.751617}
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980325') HTTP/1.1" 204 0
2026-03-25 22:53:48 [ayvens.be] INFO: Found listing with ID: 1980326
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980326%27 HTTP/1.1" 200 None
2026-03-25 22:53:48 [ayvens.be] INFO: Scrape type for 1980326: 2
2026-03-25 22:53:48 [ayvens.be] INFO: Extracting data for car ID: 1980326
2026-03-25 22:53:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-25 22:53:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694c3744-9423-597e-8981-51fdfba093c6 with scrape type 2
2026-03-25 22:53:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 694c3744-9423-597e-8981-51fdfba093c6, identifier: 1980326
2026-03-25 22:53:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-25 22:53:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326
2026-03-25 22:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 694c3744-9423-597e-8981-51fdfba093c6 with identifier: 1980326 to the API
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '694c3744-9423-597e-8981-51fdfba093c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Puma',
 'odometer': 98842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Puma 1.5 TDCI 88KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 88KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980326%27 HTTP/1.1" 200 None
2026-03-25 22:53:49 [ayvens.be] INFO: Saving data for 1980326: {'auction_closing_time': 1774530000.0, 'created_time': 1774392699.875392, 'last_price_update_time': 1774479229.500765}
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980326') HTTP/1.1" 204 0
2026-03-25 22:53:49 [ayvens.be] INFO: Found listing with ID: 1980327
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980327%27 HTTP/1.1" 200 None
2026-03-25 22:53:49 [ayvens.be] INFO: Scrape type for 1980327: 2
2026-03-25 22:53:49 [ayvens.be] INFO: Extracting data for car ID: 1980327
2026-03-25 22:53:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-25 22:53:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 2
2026-03-25 22:53:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbac0540-39df-5073-9762-7f74f4e38c3a with scrape type 2
2026-03-25 22:53:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dbac0540-39df-5073-9762-7f74f4e38c3a, identifier: 1980327
2026-03-25 22:53:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-25 22:53:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327
2026-03-25 22:53:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dbac0540-39df-5073-9762-7f74f4e38c3a with identifier: 1980327 to the API
2026-03-25 22:53:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dbac0540-39df-5073-9762-7f74f4e38c3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 183362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.0 30 TFSI ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980327%27 HTTP/1.1" 200 None
2026-03-25 22:53:50 [ayvens.be] INFO: Saving data for 1980327: {'auction_closing_time': 1774530000.0, 'created_time': 1774392702.16534, 'last_price_update_time': 1774479230.596204}
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980327') HTTP/1.1" 204 0
2026-03-25 22:53:50 [ayvens.be] INFO: Found listing with ID: 1980328
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980328%27 HTTP/1.1" 200 None
2026-03-25 22:53:50 [ayvens.be] INFO: Scrape type for 1980328: 2
2026-03-25 22:53:50 [ayvens.be] INFO: Extracting data for car ID: 1980328
2026-03-25 22:53:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-25 22:53:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 2
2026-03-25 22:53:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with scrape type 2
2026-03-25 22:53:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c, identifier: 1980328
2026-03-25 22:53:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-25 22:53:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328
2026-03-25 22:53:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 96fdc9f1-7ce0-5fb1-a642-99698f01a88c with identifier: 1980328 to the API
2026-03-25 22:53:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '96fdc9f1-7ce0-5fb1-a642-99698f01a88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 172566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980328%27 HTTP/1.1" 200 None
2026-03-25 22:53:51 [ayvens.be] INFO: Saving data for 1980328: {'auction_closing_time': 1774530000.0, 'created_time': 1774392703.432802, 'last_price_update_time': 1774479231.4451}
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980328') HTTP/1.1" 204 0
2026-03-25 22:53:51 [ayvens.be] INFO: Found listing with ID: 1980329
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980329%27 HTTP/1.1" 200 None
2026-03-25 22:53:51 [ayvens.be] INFO: Scrape type for 1980329: 2
2026-03-25 22:53:51 [ayvens.be] INFO: Extracting data for car ID: 1980329
2026-03-25 22:53:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-25 22:53:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 2
2026-03-25 22:53:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0df3679-6c69-53f3-837f-08eaed75cc34 with scrape type 2
2026-03-25 22:53:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a0df3679-6c69-53f3-837f-08eaed75cc34, identifier: 1980329
2026-03-25 22:53:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-25 22:53:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329
2026-03-25 22:53:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a0df3679-6c69-53f3-837f-08eaed75cc34 with identifier: 1980329 to the API
2026-03-25 22:53:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a0df3679-6c69-53f3-837f-08eaed75cc34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 70710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980329%27 HTTP/1.1" 200 None
2026-03-25 22:53:52 [ayvens.be] INFO: Saving data for 1980329: {'auction_closing_time': 1774530000.0, 'created_time': 1774392705.327415, 'last_price_update_time': 1774479232.605083}
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980329') HTTP/1.1" 204 0
2026-03-25 22:53:52 [ayvens.be] INFO: Found listing with ID: 1980330
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980330%27 HTTP/1.1" 200 None
2026-03-25 22:53:52 [ayvens.be] INFO: Scrape type for 1980330: 2
2026-03-25 22:53:52 [ayvens.be] INFO: Extracting data for car ID: 1980330
2026-03-25 22:53:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-25 22:53:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 2
2026-03-25 22:53:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb7e5240-8a65-5e03-80d9-ed222dac75cd with scrape type 2
2026-03-25 22:53:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb7e5240-8a65-5e03-80d9-ed222dac75cd, identifier: 1980330
2026-03-25 22:53:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-25 22:53:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330
2026-03-25 22:53:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb7e5240-8a65-5e03-80d9-ed222dac75cd with identifier: 1980330 to the API
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb7e5240-8a65-5e03-80d9-ed222dac75cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 54559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2024}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980330%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Saving data for 1980330: {'auction_closing_time': 1774530000.0, 'created_time': 1774392706.197963, 'last_price_update_time': 1774479233.018109}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980330') HTTP/1.1" 204 0
2026-03-25 22:53:53 [ayvens.be] INFO: Found listing with ID: 1980331
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980331%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Scrape type for 1980331: 2
2026-03-25 22:53:53 [ayvens.be] INFO: Extracting data for car ID: 1980331
2026-03-25 22:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-25 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 054bf54d-3f34-5d87-91cc-317a6a689a28 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 054bf54d-3f34-5d87-91cc-317a6a689a28, identifier: 1980331
2026-03-25 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-25 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331
2026-03-25 22:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 054bf54d-3f34-5d87-91cc-317a6a689a28 with identifier: 1980331 to the API
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'DARK PENTA METAL METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '054bf54d-3f34-5d87-91cc-317a6a689a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D SPORTSWAGON",
 'odometer': 79955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D SPORTSWAGON 1.6 GDI PHEV BUSINESS LINE DCT",
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV BUSINESS LINE DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980331%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Saving data for 1980331: {'auction_closing_time': 1774530000.0, 'created_time': 1774392708.7997, 'last_price_update_time': 1774479233.440549}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980331') HTTP/1.1" 204 0
2026-03-25 22:53:53 [ayvens.be] INFO: Found listing with ID: 1980332
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980332%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Scrape type for 1980332: 2
2026-03-25 22:53:53 [ayvens.be] INFO: Extracting data for car ID: 1980332
2026-03-25 22:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-25 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81745107-cd5b-55d7-b04b-60f6322262e6 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81745107-cd5b-55d7-b04b-60f6322262e6, identifier: 1980332
2026-03-25 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-25 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332
2026-03-25 22:53:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81745107-cd5b-55d7-b04b-60f6322262e6 with identifier: 1980332 to the API
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '81745107-cd5b-55d7-b04b-60f6322262e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 55405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980332%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Saving data for 1980332: {'auction_closing_time': 1774530000.0, 'created_time': 1774392709.95607, 'last_price_update_time': 1774479233.80643}
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980332') HTTP/1.1" 204 0
2026-03-25 22:53:53 [ayvens.be] INFO: Found listing with ID: 1980333
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980333%27 HTTP/1.1" 200 None
2026-03-25 22:53:53 [ayvens.be] INFO: Scrape type for 1980333: 2
2026-03-25 22:53:53 [ayvens.be] INFO: Extracting data for car ID: 1980333
2026-03-25 22:53:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-25 22:53:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e478d88-9255-5fdd-848c-32c5ddc31c17 with scrape type 2
2026-03-25 22:53:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6e478d88-9255-5fdd-848c-32c5ddc31c17, identifier: 1980333
2026-03-25 22:53:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-25 22:53:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333
2026-03-25 22:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6e478d88-9255-5fdd-848c-32c5ddc31c17 with identifier: 1980333 to the API
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6e478d88-9255-5fdd-848c-32c5ddc31c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 95069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980333%27 HTTP/1.1" 200 None
2026-03-25 22:53:54 [ayvens.be] INFO: Saving data for 1980333: {'auction_closing_time': 1774530000.0, 'created_time': 1774392711.059545, 'last_price_update_time': 1774479234.183386}
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980333') HTTP/1.1" 204 0
2026-03-25 22:53:54 [ayvens.be] INFO: Found listing with ID: 1980334
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980334%27 HTTP/1.1" 200 None
2026-03-25 22:53:54 [ayvens.be] INFO: Scrape type for 1980334: 2
2026-03-25 22:53:54 [ayvens.be] INFO: Extracting data for car ID: 1980334
2026-03-25 22:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-25 22:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 2
2026-03-25 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0597b31-b618-5a7c-9897-7d9733dea90c with scrape type 2
2026-03-25 22:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b0597b31-b618-5a7c-9897-7d9733dea90c, identifier: 1980334
2026-03-25 22:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-25 22:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334
2026-03-25 22:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b0597b31-b618-5a7c-9897-7d9733dea90c with identifier: 1980334 to the API
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b0597b31-b618-5a7c-9897-7d9733dea90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 102948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980334%27 HTTP/1.1" 200 None
2026-03-25 22:53:54 [ayvens.be] INFO: Saving data for 1980334: {'auction_closing_time': 1774530000.0, 'created_time': 1774392712.721243, 'last_price_update_time': 1774479234.652449}
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980334') HTTP/1.1" 204 0
2026-03-25 22:53:54 [ayvens.be] INFO: Found listing with ID: 1980335
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980335%27 HTTP/1.1" 200 None
2026-03-25 22:53:54 [ayvens.be] INFO: Scrape type for 1980335: 2
2026-03-25 22:53:54 [ayvens.be] INFO: Extracting data for car ID: 1980335
2026-03-25 22:53:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-25 22:53:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 2
2026-03-25 22:53:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10aede45-dc31-5ff5-8678-55acc89a1832 with scrape type 2
2026-03-25 22:53:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10aede45-dc31-5ff5-8678-55acc89a1832, identifier: 1980335
2026-03-25 22:53:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-25 22:53:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335
2026-03-25 22:53:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10aede45-dc31-5ff5-8678-55acc89a1832 with identifier: 1980335 to the API
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '10aede45-dc31-5ff5-8678-55acc89a1832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLB DIESEL (X247)',
 'odometer': 106199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLB DIESEL (X247) GLB 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'GLB 200 d Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980335%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Saving data for 1980335: {'auction_closing_time': 1774530000.0, 'created_time': 1774392713.880824, 'last_price_update_time': 1774479235.039898}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980335') HTTP/1.1" 204 0
2026-03-25 22:53:55 [ayvens.be] INFO: Found listing with ID: 1980336
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980336%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Scrape type for 1980336: 2
2026-03-25 22:53:55 [ayvens.be] INFO: Extracting data for car ID: 1980336
2026-03-25 22:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-25 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 2
2026-03-25 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85823419-bea0-53d2-b46c-8cd10925d2b0 with scrape type 2
2026-03-25 22:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85823419-bea0-53d2-b46c-8cd10925d2b0, identifier: 1980336
2026-03-25 22:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-25 22:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336
2026-03-25 22:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85823419-bea0-53d2-b46c-8cd10925d2b0 with identifier: 1980336 to the API
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '85823419-bea0-53d2-b46c-8cd10925d2b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980336%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Saving data for 1980336: {'auction_closing_time': 1774530000.0, 'created_time': 1774392715.345835, 'last_price_update_time': 1774479235.401201}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980336') HTTP/1.1" 204 0
2026-03-25 22:53:55 [ayvens.be] INFO: Found listing with ID: 1980337
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980337%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Scrape type for 1980337: 2
2026-03-25 22:53:55 [ayvens.be] INFO: Extracting data for car ID: 1980337
2026-03-25 22:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-25 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 2
2026-03-25 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3f7c41-dc83-5791-8842-4fd94dd6637f with scrape type 2
2026-03-25 22:53:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac3f7c41-dc83-5791-8842-4fd94dd6637f, identifier: 1980337
2026-03-25 22:53:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-25 22:53:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:53:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337
2026-03-25 22:53:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ac3f7c41-dc83-5791-8842-4fd94dd6637f with identifier: 1980337 to the API
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'COSMOSZWART',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ac3f7c41-dc83-5791-8842-4fd94dd6637f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 120855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 180 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 A 180 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980337%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Saving data for 1980337: {'auction_closing_time': 1774530000.0, 'created_time': 1774392717.284993, 'last_price_update_time': 1774479235.883667}
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980337') HTTP/1.1" 204 0
2026-03-25 22:53:55 [ayvens.be] INFO: Found listing with ID: 1980338
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980338%27 HTTP/1.1" 200 None
2026-03-25 22:53:55 [ayvens.be] INFO: Scrape type for 1980338: 2
2026-03-25 22:53:55 [ayvens.be] INFO: Extracting data for car ID: 1980338
2026-03-25 22:53:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-25 22:53:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 2
2026-03-25 22:53:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1b32218-266b-566a-b43d-7beff4118cd2 with scrape type 2
2026-03-25 22:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1b32218-266b-566a-b43d-7beff4118cd2, identifier: 1980338
2026-03-25 22:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-25 22:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338
2026-03-25 22:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d1b32218-266b-566a-b43d-7beff4118cd2 with identifier: 1980338 to the API
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd1b32218-266b-566a-b43d-7beff4118cd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 139745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980338%27 HTTP/1.1" 200 None
2026-03-25 22:53:56 [ayvens.be] INFO: Saving data for 1980338: {'auction_closing_time': 1774530000.0, 'created_time': 1774392718.551797, 'last_price_update_time': 1774479236.261033}
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980338') HTTP/1.1" 204 0
2026-03-25 22:53:56 [ayvens.be] INFO: Found listing with ID: 1980339
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980339%27 HTTP/1.1" 200 None
2026-03-25 22:53:56 [ayvens.be] INFO: Scrape type for 1980339: 2
2026-03-25 22:53:56 [ayvens.be] INFO: Extracting data for car ID: 1980339
2026-03-25 22:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-25 22:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65337357-52f9-53c5-aad2-e9c036ec7437 with scrape type 2
2026-03-25 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65337357-52f9-53c5-aad2-e9c036ec7437 with scrape type 2
2026-03-25 22:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 65337357-52f9-53c5-aad2-e9c036ec7437, identifier: 1980339
2026-03-25 22:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-25 22:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339
2026-03-25 22:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 65337357-52f9-53c5-aad2-e9c036ec7437 with identifier: 1980339 to the API
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '65337357-52f9-53c5-aad2-e9c036ec7437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3-serie',
 'odometer': 56141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3-serie 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980339%27 HTTP/1.1" 200 None
2026-03-25 22:53:56 [ayvens.be] INFO: Saving data for 1980339: {'auction_closing_time': 1774530000.0, 'created_time': 1774392720.567764, 'last_price_update_time': 1774479236.63794}
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980339') HTTP/1.1" 204 0
2026-03-25 22:53:56 [ayvens.be] INFO: Found listing with ID: 1980340
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980340%27 HTTP/1.1" 200 None
2026-03-25 22:53:56 [ayvens.be] INFO: Scrape type for 1980340: 2
2026-03-25 22:53:56 [ayvens.be] INFO: Extracting data for car ID: 1980340
2026-03-25 22:53:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-25 22:53:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 2
2026-03-25 22:53:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f848b84-78f6-5388-b7ab-a5470e154ec1 with scrape type 2
2026-03-25 22:53:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f848b84-78f6-5388-b7ab-a5470e154ec1, identifier: 1980340
2026-03-25 22:53:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-25 22:53:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340
2026-03-25 22:53:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f848b84-78f6-5388-b7ab-a5470e154ec1 with identifier: 1980340 to the API
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9f848b84-78f6-5388-b7ab-a5470e154ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 53679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'transmission': 'automatic',
 'trim': '1.5 225E PHEV DCT XDRIVE ACTIVE TOURER',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980340%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Saving data for 1980340: {'auction_closing_time': 1774530000.0, 'created_time': 1774392722.285078, 'last_price_update_time': 1774479237.04375}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980340') HTTP/1.1" 204 0
2026-03-25 22:53:57 [ayvens.be] INFO: Found listing with ID: 1980341
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980341%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Scrape type for 1980341: 2
2026-03-25 22:53:57 [ayvens.be] INFO: Extracting data for car ID: 1980341
2026-03-25 22:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-25 22:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d, identifier: 1980341
2026-03-25 22:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-25 22:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341
2026-03-25 22:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d with identifier: 1980341 to the API
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '24c055fd-c5e1-5a7a-93e4-e0d3d7f0e96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 120814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 518D 110KW TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 110KW TOURING AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980341%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Saving data for 1980341: {'auction_closing_time': 1774530000.0, 'created_time': 1774392723.155526, 'last_price_update_time': 1774479237.413298}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980341') HTTP/1.1" 204 0
2026-03-25 22:53:57 [ayvens.be] INFO: Found listing with ID: 1980342
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980342%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Scrape type for 1980342: 2
2026-03-25 22:53:57 [ayvens.be] INFO: Extracting data for car ID: 1980342
2026-03-25 22:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-25 22:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f721e15-332b-51f4-b704-261dcb3d5496 with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3f721e15-332b-51f4-b704-261dcb3d5496, identifier: 1980342
2026-03-25 22:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-25 22:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342
2026-03-25 22:53:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3f721e15-332b-51f4-b704-261dcb3d5496 with identifier: 1980342 to the API
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f721e15-332b-51f4-b704-261dcb3d5496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 56982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980342%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Saving data for 1980342: {'auction_closing_time': 1774530000.0, 'created_time': 1774392725.01426, 'last_price_update_time': 1774479237.791558}
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980342') HTTP/1.1" 204 0
2026-03-25 22:53:57 [ayvens.be] INFO: Found listing with ID: 1980343
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980343%27 HTTP/1.1" 200 None
2026-03-25 22:53:57 [ayvens.be] INFO: Scrape type for 1980343: 2
2026-03-25 22:53:57 [ayvens.be] INFO: Extracting data for car ID: 1980343
2026-03-25 22:53:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-25 22:53:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553a68b8-cbe1-5949-add3-97bebbbbfdee with scrape type 2
2026-03-25 22:53:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 553a68b8-cbe1-5949-add3-97bebbbbfdee, identifier: 1980343
2026-03-25 22:53:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-25 22:53:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343
2026-03-25 22:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 553a68b8-cbe1-5949-add3-97bebbbbfdee with identifier: 1980343 to the API
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '553a68b8-cbe1-5949-add3-97bebbbbfdee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 59283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980343%27 HTTP/1.1" 200 None
2026-03-25 22:53:58 [ayvens.be] INFO: Saving data for 1980343: {'auction_closing_time': 1774530000.0, 'created_time': 1774392727.222281, 'last_price_update_time': 1774479238.216685}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980343') HTTP/1.1" 204 0
2026-03-25 22:53:58 [ayvens.be] INFO: Found listing with ID: 1980344
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980344%27 HTTP/1.1" 200 None
2026-03-25 22:53:58 [ayvens.be] INFO: Scrape type for 1980344: 2
2026-03-25 22:53:58 [ayvens.be] INFO: Extracting data for car ID: 1980344
2026-03-25 22:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-25 22:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 2
2026-03-25 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with scrape type 2
2026-03-25 22:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0, identifier: 1980344
2026-03-25 22:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-25 22:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344
2026-03-25 22:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f23d59d4-bf04-53b9-9d1d-7ba64f201fe0 with identifier: 1980344 to the API
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f23d59d4-bf04-53b9-9d1d-7ba64f201fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'Octavia',
 'odometer': 86813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 1.4 TSI PHEV 150KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980344%27 HTTP/1.1" 200 None
2026-03-25 22:53:58 [ayvens.be] INFO: Saving data for 1980344: {'auction_closing_time': 1774530000.0, 'created_time': 1774392728.637483, 'last_price_update_time': 1774479238.592707}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980344') HTTP/1.1" 204 0
2026-03-25 22:53:58 [ayvens.be] INFO: Found listing with ID: 1980345
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980345%27 HTTP/1.1" 200 None
2026-03-25 22:53:58 [ayvens.be] INFO: Scrape type for 1980345: 2
2026-03-25 22:53:58 [ayvens.be] INFO: Extracting data for car ID: 1980345
2026-03-25 22:53:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-25 22:53:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 2
2026-03-25 22:53:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63e367b0-917d-51cc-9c21-36a4976b89c1 with scrape type 2
2026-03-25 22:53:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63e367b0-917d-51cc-9c21-36a4976b89c1, identifier: 1980345
2026-03-25 22:53:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-25 22:53:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345
2026-03-25 22:53:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63e367b0-917d-51cc-9c21-36a4976b89c1 with identifier: 1980345 to the API
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '63e367b0-917d-51cc-9c21-36a4976b89c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 91752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980345%27 HTTP/1.1" 200 None
2026-03-25 22:53:58 [ayvens.be] INFO: Saving data for 1980345: {'auction_closing_time': 1774530000.0, 'created_time': 1774392729.681657, 'last_price_update_time': 1774479238.981284}
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980345') HTTP/1.1" 204 0
2026-03-25 22:53:58 [ayvens.be] INFO: Found listing with ID: 1980346
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980346%27 HTTP/1.1" 200 None
2026-03-25 22:53:59 [ayvens.be] INFO: Scrape type for 1980346: 2
2026-03-25 22:53:59 [ayvens.be] INFO: Extracting data for car ID: 1980346
2026-03-25 22:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-25 22:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7daffc16-00ab-5d2a-b461-726a3cb29f81 with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7daffc16-00ab-5d2a-b461-726a3cb29f81, identifier: 1980346
2026-03-25 22:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-25 22:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346
2026-03-25 22:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7daffc16-00ab-5d2a-b461-726a3cb29f81 with identifier: 1980346 to the API
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7daffc16-00ab-5d2a-b461-726a3cb29f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 29648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW',
 'vin': None,
 'year': 2023}
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980346%27 HTTP/1.1" 200 None
2026-03-25 22:53:59 [ayvens.be] INFO: Saving data for 1980346: {'auction_closing_time': 1774530000.0, 'created_time': 1774392732.171455, 'last_price_update_time': 1774479239.384672}
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980346') HTTP/1.1" 204 0
2026-03-25 22:53:59 [ayvens.be] INFO: Found listing with ID: 1980347
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980347%27 HTTP/1.1" 200 None
2026-03-25 22:53:59 [ayvens.be] INFO: Scrape type for 1980347: 2
2026-03-25 22:53:59 [ayvens.be] INFO: Extracting data for car ID: 1980347
2026-03-25 22:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-25 22:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e89b0c35-1801-582d-a8b4-24273842471b with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e89b0c35-1801-582d-a8b4-24273842471b, identifier: 1980347
2026-03-25 22:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-25 22:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347
2026-03-25 22:53:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e89b0c35-1801-582d-a8b4-24273842471b with identifier: 1980347 to the API
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:53:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e89b0c35-1801-582d-a8b4-24273842471b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 95959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980347%27 HTTP/1.1" 200 None
2026-03-25 22:53:59 [ayvens.be] INFO: Saving data for 1980347: {'auction_closing_time': 1774530000.0, 'created_time': 1774392733.63158, 'last_price_update_time': 1774479239.752837}
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980347') HTTP/1.1" 204 0
2026-03-25 22:53:59 [ayvens.be] INFO: Found listing with ID: 1980348
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:53:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980348%27 HTTP/1.1" 200 None
2026-03-25 22:53:59 [ayvens.be] INFO: Scrape type for 1980348: 2
2026-03-25 22:53:59 [ayvens.be] INFO: Extracting data for car ID: 1980348
2026-03-25 22:53:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-25 22:53:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d631ba-76f2-5865-bce7-5ea052ac5323 with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0d631ba-76f2-5865-bce7-5ea052ac5323 with scrape type 2
2026-03-25 22:53:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0d631ba-76f2-5865-bce7-5ea052ac5323, identifier: 1980348
2026-03-25 22:53:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-25 22:53:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348
2026-03-25 22:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0d631ba-76f2-5865-bce7-5ea052ac5323 with identifier: 1980348 to the API
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd0d631ba-76f2-5865-bce7-5ea052ac5323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'TONALE',
 'odometer': 58482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO TONALE 1.3 PHEV 206KW 4WD AUTO VELOCE',
 'transmission': 'automatic',
 'trim': '1.3 PHEV 206KW 4WD AUTO VELOCE',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980348%27 HTTP/1.1" 200 None
2026-03-25 22:54:00 [ayvens.be] INFO: Saving data for 1980348: {'auction_closing_time': 1774530000.0, 'created_time': 1774392734.407827, 'last_price_update_time': 1774479240.247176}
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980348') HTTP/1.1" 204 0
2026-03-25 22:54:00 [ayvens.be] INFO: Found listing with ID: 1980349
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980349%27 HTTP/1.1" 200 None
2026-03-25 22:54:00 [ayvens.be] INFO: Scrape type for 1980349: 2
2026-03-25 22:54:00 [ayvens.be] INFO: Extracting data for car ID: 1980349
2026-03-25 22:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-25 22:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 2
2026-03-25 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d369e5-2928-5f10-b01e-b85ea21d67cf with scrape type 2
2026-03-25 22:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 54d369e5-2928-5f10-b01e-b85ea21d67cf, identifier: 1980349
2026-03-25 22:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-25 22:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349
2026-03-25 22:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 54d369e5-2928-5f10-b01e-b85ea21d67cf with identifier: 1980349 to the API
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '54d369e5-2928-5f10-b01e-b85ea21d67cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 112829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980349%27 HTTP/1.1" 200 None
2026-03-25 22:54:00 [ayvens.be] INFO: Saving data for 1980349: {'auction_closing_time': 1774530000.0, 'created_time': 1774392735.871391, 'last_price_update_time': 1774479240.631843}
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980349') HTTP/1.1" 204 0
2026-03-25 22:54:00 [ayvens.be] INFO: Found listing with ID: 1980350
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980350%27 HTTP/1.1" 200 None
2026-03-25 22:54:00 [ayvens.be] INFO: Scrape type for 1980350: 2
2026-03-25 22:54:00 [ayvens.be] INFO: Extracting data for car ID: 1980350
2026-03-25 22:54:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-25 22:54:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with scrape type 2
2026-03-25 22:54:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with scrape type 2
2026-03-25 22:54:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785, identifier: 1980350
2026-03-25 22:54:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-25 22:54:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350
2026-03-25 22:54:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785 with identifier: 1980350 to the API
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef5d0249-b47d-5e0a-b0b9-c6b4cdcd6785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 84566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980350%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Saving data for 1980350: {'auction_closing_time': 1774530000.0, 'created_time': 1774392737.946281, 'last_price_update_time': 1774479241.03293}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980350') HTTP/1.1" 204 0
2026-03-25 22:54:01 [ayvens.be] INFO: Found listing with ID: 1980351
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980351%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Scrape type for 1980351: 2
2026-03-25 22:54:01 [ayvens.be] INFO: Extracting data for car ID: 1980351
2026-03-25 22:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-25 22:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with scrape type 2
2026-03-25 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with scrape type 2
2026-03-25 22:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6be1dc48-9840-50dc-ac8c-5bc670c797c0, identifier: 1980351
2026-03-25 22:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-25 22:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351
2026-03-25 22:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6be1dc48-9840-50dc-ac8c-5bc670c797c0 with identifier: 1980351 to the API
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6be1dc48-9840-50dc-ac8c-5bc670c797c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 93435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTR INSCRIPTION EXPR',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980351%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Saving data for 1980351: {'auction_closing_time': 1774530000.0, 'created_time': 1774392739.233966, 'last_price_update_time': 1774479241.544036}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980351') HTTP/1.1" 204 0
2026-03-25 22:54:01 [ayvens.be] INFO: Found listing with ID: 1980352
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980352%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Scrape type for 1980352: 2
2026-03-25 22:54:01 [ayvens.be] INFO: Extracting data for car ID: 1980352
2026-03-25 22:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-25 22:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 2
2026-03-25 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af974b1e-bc76-523e-80e0-698c29fe183c with scrape type 2
2026-03-25 22:54:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af974b1e-bc76-523e-80e0-698c29fe183c, identifier: 1980352
2026-03-25 22:54:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-25 22:54:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352
2026-03-25 22:54:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af974b1e-bc76-523e-80e0-698c29fe183c with identifier: 1980352 to the API
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af974b1e-bc76-523e-80e0-698c29fe183c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'MULTIVAN LANG',
 'odometer': 75696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN MULTIVAN LANG 1.4 EHYBRID PHEV DSG EXT STYLE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID PHEV DSG EXT STYLE',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980352%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Saving data for 1980352: {'auction_closing_time': 1774530000.0, 'created_time': 1774392741.726216, 'last_price_update_time': 1774479241.944897}
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980352') HTTP/1.1" 204 0
2026-03-25 22:54:01 [ayvens.be] INFO: Found listing with ID: 1980353
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980353%27 HTTP/1.1" 200 None
2026-03-25 22:54:01 [ayvens.be] INFO: Scrape type for 1980353: 2
2026-03-25 22:54:01 [ayvens.be] INFO: Extracting data for car ID: 1980353
2026-03-25 22:54:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-25 22:54:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 2
2026-03-25 22:54:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 798116e5-b8de-5252-8955-1d1dbebba461 with scrape type 2
2026-03-25 22:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798116e5-b8de-5252-8955-1d1dbebba461, identifier: 1980353
2026-03-25 22:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-25 22:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353
2026-03-25 22:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798116e5-b8de-5252-8955-1d1dbebba461 with identifier: 1980353 to the API
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '798116e5-b8de-5252-8955-1d1dbebba461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 87053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2019}
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980353%27 HTTP/1.1" 200 None
2026-03-25 22:54:02 [ayvens.be] INFO: Saving data for 1980353: {'auction_closing_time': 1774530000.0, 'created_time': 1774392742.54808, 'last_price_update_time': 1774479242.339217}
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980353') HTTP/1.1" 204 0
2026-03-25 22:54:02 [ayvens.be] INFO: Found listing with ID: 1980354
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980354%27 HTTP/1.1" 200 None
2026-03-25 22:54:02 [ayvens.be] INFO: Scrape type for 1980354: 2
2026-03-25 22:54:02 [ayvens.be] INFO: Extracting data for car ID: 1980354
2026-03-25 22:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-25 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 2
2026-03-25 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with scrape type 2
2026-03-25 22:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4, identifier: 1980354
2026-03-25 22:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-25 22:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354
2026-03-25 22:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6235cf64-c13d-5557-9b9a-f84c9caa6fd4 with identifier: 1980354 to the API
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6235cf64-c13d-5557-9b9a-f84c9caa6fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 105698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ALLURE',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ALLURE',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980354%27 HTTP/1.1" 200 None
2026-03-25 22:54:02 [ayvens.be] INFO: Saving data for 1980354: {'auction_closing_time': 1774530000.0, 'created_time': 1774392744.848024, 'last_price_update_time': 1774479242.737844}
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980354') HTTP/1.1" 204 0
2026-03-25 22:54:02 [ayvens.be] INFO: Found listing with ID: 1980355
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980355%27 HTTP/1.1" 200 None
2026-03-25 22:54:02 [ayvens.be] INFO: Scrape type for 1980355: 2
2026-03-25 22:54:02 [ayvens.be] INFO: Extracting data for car ID: 1980355
2026-03-25 22:54:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-25 22:54:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 2
2026-03-25 22:54:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with scrape type 2
2026-03-25 22:54:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f, identifier: 1980355
2026-03-25 22:54:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-25 22:54:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355
2026-03-25 22:54:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 743ab5aa-3ca7-595a-9611-e0a7ffd4376f with identifier: 1980355 to the API
2026-03-25 22:54:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '743ab5aa-3ca7-595a-9611-e0a7ffd4376f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 115975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV CORE AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV CORE AUTO 4WD',
 'vin': None,
 'year': 2024}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980355%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Saving data for 1980355: {'auction_closing_time': 1774530000.0, 'created_time': 1774392746.095592, 'last_price_update_time': 1774479243.124815}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980355') HTTP/1.1" 204 0
2026-03-25 22:54:03 [ayvens.be] INFO: Found listing with ID: 1980356
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980356%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Scrape type for 1980356: 2
2026-03-25 22:54:03 [ayvens.be] INFO: Extracting data for car ID: 1980356
2026-03-25 22:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-25 22:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 2
2026-03-25 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with scrape type 2
2026-03-25 22:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0, identifier: 1980356
2026-03-25 22:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-25 22:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356
2026-03-25 22:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 274ec52a-7bd4-5d37-b9e6-692b9194f3b0 with identifier: 1980356 to the API
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '274ec52a-7bd4-5d37-b9e6-692b9194f3b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 107725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S FEEL AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S FEEL AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980356%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Saving data for 1980356: {'auction_closing_time': 1774530000.0, 'created_time': 1774392748.058564, 'last_price_update_time': 1774479243.513782}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980356') HTTP/1.1" 204 0
2026-03-25 22:54:03 [ayvens.be] INFO: Found listing with ID: 1980357
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980357%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Scrape type for 1980357: 2
2026-03-25 22:54:03 [ayvens.be] INFO: Extracting data for car ID: 1980357
2026-03-25 22:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-25 22:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 2
2026-03-25 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d291316e-e7fb-5331-8027-e134326c102a with scrape type 2
2026-03-25 22:54:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d291316e-e7fb-5331-8027-e134326c102a, identifier: 1980357
2026-03-25 22:54:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-25 22:54:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357
2026-03-25 22:54:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d291316e-e7fb-5331-8027-e134326c102a with identifier: 1980357 to the API
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd291316e-e7fb-5331-8027-e134326c102a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980357%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Saving data for 1980357: {'auction_closing_time': 1774530000.0, 'created_time': 1774392749.694034, 'last_price_update_time': 1774479243.878066}
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980357') HTTP/1.1" 204 0
2026-03-25 22:54:03 [ayvens.be] INFO: Found listing with ID: 1980358
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980358%27 HTTP/1.1" 200 None
2026-03-25 22:54:03 [ayvens.be] INFO: Scrape type for 1980358: 2
2026-03-25 22:54:03 [ayvens.be] INFO: Extracting data for car ID: 1980358
2026-03-25 22:54:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-25 22:54:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 2
2026-03-25 22:54:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with scrape type 2
2026-03-25 22:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2, identifier: 1980358
2026-03-25 22:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-25 22:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358
2026-03-25 22:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 30779306-d801-5b7a-b9b1-8ea1ead4d1c2 with identifier: 1980358 to the API
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '30779306-d801-5b7a-b9b1-8ea1ead4d1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 106736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980358%27 HTTP/1.1" 200 None
2026-03-25 22:54:04 [ayvens.be] INFO: Saving data for 1980358: {'auction_closing_time': 1774530000.0, 'created_time': 1774392750.914522, 'last_price_update_time': 1774479244.255394}
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980358') HTTP/1.1" 204 0
2026-03-25 22:54:04 [ayvens.be] INFO: Found listing with ID: 1980359
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980359%27 HTTP/1.1" 200 None
2026-03-25 22:54:04 [ayvens.be] INFO: Scrape type for 1980359: 2
2026-03-25 22:54:04 [ayvens.be] INFO: Extracting data for car ID: 1980359
2026-03-25 22:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-25 22:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 2
2026-03-25 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with scrape type 2
2026-03-25 22:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19, identifier: 1980359
2026-03-25 22:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-25 22:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359
2026-03-25 22:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19 with identifier: 1980359 to the API
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8c3cd0c-7bfc-5763-9066-bf7cc29bfa19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 100209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980359%27 HTTP/1.1" 200 None
2026-03-25 22:54:04 [ayvens.be] INFO: Saving data for 1980359: {'auction_closing_time': 1774530000.0, 'created_time': 1774392752.103249, 'last_price_update_time': 1774479244.717035}
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980359') HTTP/1.1" 204 0
2026-03-25 22:54:04 [ayvens.be] INFO: Found listing with ID: 1980360
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980360%27 HTTP/1.1" 200 None
2026-03-25 22:54:04 [ayvens.be] INFO: Scrape type for 1980360: 2
2026-03-25 22:54:04 [ayvens.be] INFO: Extracting data for car ID: 1980360
2026-03-25 22:54:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-25 22:54:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 2
2026-03-25 22:54:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a785095c-c896-5b3b-9fac-f87b2e173115 with scrape type 2
2026-03-25 22:54:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a785095c-c896-5b3b-9fac-f87b2e173115, identifier: 1980360
2026-03-25 22:54:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-25 22:54:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360
2026-03-25 22:54:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a785095c-c896-5b3b-9fac-f87b2e173115 with identifier: 1980360 to the API
2026-03-25 22:54:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a785095c-c896-5b3b-9fac-f87b2e173115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 48154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TSI 130 MOVE!',
 'transmission': 'manual',
 'trim': '1.5 TSI 130 MOVE!',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980360%27 HTTP/1.1" 200 None
2026-03-25 22:54:05 [ayvens.be] INFO: Saving data for 1980360: {'auction_closing_time': 1774530000.0, 'created_time': 1774392753.365472, 'last_price_update_time': 1774479245.149371}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980360') HTTP/1.1" 204 0
2026-03-25 22:54:05 [ayvens.be] INFO: Found listing with ID: 1980361
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980361%27 HTTP/1.1" 200 None
2026-03-25 22:54:05 [ayvens.be] INFO: Scrape type for 1980361: 2
2026-03-25 22:54:05 [ayvens.be] INFO: Extracting data for car ID: 1980361
2026-03-25 22:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-25 22:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 2
2026-03-25 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db4811c8-bd53-558b-b1fd-f2e5723c3231 with scrape type 2
2026-03-25 22:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db4811c8-bd53-558b-b1fd-f2e5723c3231, identifier: 1980361
2026-03-25 22:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-25 22:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361
2026-03-25 22:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: db4811c8-bd53-558b-b1fd-f2e5723c3231 with identifier: 1980361 to the API
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'db4811c8-bd53-558b-b1fd-f2e5723c3231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 65895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980361%27 HTTP/1.1" 200 None
2026-03-25 22:54:05 [ayvens.be] INFO: Saving data for 1980361: {'auction_closing_time': 1774530000.0, 'created_time': 1774392755.345032, 'last_price_update_time': 1774479245.547058}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980361') HTTP/1.1" 204 0
2026-03-25 22:54:05 [ayvens.be] INFO: Found listing with ID: 1980362
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980362%27 HTTP/1.1" 200 None
2026-03-25 22:54:05 [ayvens.be] INFO: Scrape type for 1980362: 2
2026-03-25 22:54:05 [ayvens.be] INFO: Extracting data for car ID: 1980362
2026-03-25 22:54:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-25 22:54:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 2
2026-03-25 22:54:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f4d39c-835f-57b7-985d-07092ee2af02 with scrape type 2
2026-03-25 22:54:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7f4d39c-835f-57b7-985d-07092ee2af02, identifier: 1980362
2026-03-25 22:54:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-25 22:54:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362
2026-03-25 22:54:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7f4d39c-835f-57b7-985d-07092ee2af02 with identifier: 1980362 to the API
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b7f4d39c-835f-57b7-985d-07092ee2af02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 56256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 185KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 185KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980362%27 HTTP/1.1" 200 None
2026-03-25 22:54:05 [ayvens.be] INFO: Saving data for 1980362: {'auction_closing_time': 1774530000.0, 'created_time': 1774392756.7238, 'last_price_update_time': 1774479245.933348}
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980362') HTTP/1.1" 204 0
2026-03-25 22:54:05 [ayvens.be] INFO: Found listing with ID: 1980363
2026-03-25 22:54:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980363%27 HTTP/1.1" 200 None
2026-03-25 22:54:06 [ayvens.be] INFO: Scrape type for 1980363: 2
2026-03-25 22:54:06 [ayvens.be] INFO: Extracting data for car ID: 1980363
2026-03-25 22:54:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-25 22:54:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 2
2026-03-25 22:54:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a83606b-6a2f-5845-a171-3506d77c25a9 with scrape type 2
2026-03-25 22:54:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a83606b-6a2f-5845-a171-3506d77c25a9, identifier: 1980363
2026-03-25 22:54:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-25 22:54:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363
2026-03-25 22:54:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a83606b-6a2f-5845-a171-3506d77c25a9 with identifier: 1980363 to the API
2026-03-25 22:54:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a83606b-6a2f-5845-a171-3506d77c25a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 106366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980363%27 HTTP/1.1" 200 None
2026-03-25 22:54:07 [ayvens.be] INFO: Saving data for 1980363: {'auction_closing_time': 1774530000.0, 'created_time': 1774392758.227314, 'last_price_update_time': 1774479247.737547}
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980363') HTTP/1.1" 204 0
2026-03-25 22:54:07 [ayvens.be] INFO: Found listing with ID: 1980364
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980364%27 HTTP/1.1" 200 None
2026-03-25 22:54:07 [ayvens.be] INFO: Scrape type for 1980364: 2
2026-03-25 22:54:07 [ayvens.be] INFO: Extracting data for car ID: 1980364
2026-03-25 22:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-25 22:54:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e63bec-f144-5fda-a4ad-f8599f98ab51 with scrape type 2
2026-03-25 22:54:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5e63bec-f144-5fda-a4ad-f8599f98ab51 with scrape type 2
2026-03-25 22:54:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5e63bec-f144-5fda-a4ad-f8599f98ab51, identifier: 1980364
2026-03-25 22:54:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 571 items (at 127 items/min)
2026-03-25 22:54:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:54:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-25 22:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364
2026-03-25 22:54:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5e63bec-f144-5fda-a4ad-f8599f98ab51 with identifier: 1980364 to the API
2026-03-25 22:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e5e63bec-f144-5fda-a4ad-f8599f98ab51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 49652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 ROADTRIP',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 ROADTRIP',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980364%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Saving data for 1980364: {'auction_closing_time': 1774530000.0, 'created_time': 1774392759.815599, 'last_price_update_time': 1774479248.130222}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980364') HTTP/1.1" 204 0
2026-03-25 22:54:08 [ayvens.be] INFO: Found listing with ID: 1980365
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980365%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Scrape type for 1980365: 2
2026-03-25 22:54:08 [ayvens.be] INFO: Extracting data for car ID: 1980365
2026-03-25 22:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-25 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 2
2026-03-25 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99e8d78-c155-5dae-996d-4af8f0bf5beb with scrape type 2
2026-03-25 22:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d99e8d78-c155-5dae-996d-4af8f0bf5beb, identifier: 1980365
2026-03-25 22:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-25 22:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365
2026-03-25 22:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d99e8d78-c155-5dae-996d-4af8f0bf5beb with identifier: 1980365 to the API
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd99e8d78-c155-5dae-996d-4af8f0bf5beb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 120860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980365%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Saving data for 1980365: {'auction_closing_time': 1774530000.0, 'created_time': 1774392761.090752, 'last_price_update_time': 1774479248.518526}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980365') HTTP/1.1" 204 0
2026-03-25 22:54:08 [ayvens.be] INFO: Found listing with ID: 1980366
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980366%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Scrape type for 1980366: 2
2026-03-25 22:54:08 [ayvens.be] INFO: Extracting data for car ID: 1980366
2026-03-25 22:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-25 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 2
2026-03-25 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with scrape type 2
2026-03-25 22:54:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc, identifier: 1980366
2026-03-25 22:54:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-25 22:54:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366
2026-03-25 22:54:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 67ef6410-cbdb-5f79-bd50-4d8fb92361cc with identifier: 1980366 to the API
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '67ef6410-cbdb-5f79-bd50-4d8fb92361cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'Kangoo',
 'odometer': 20688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT Kangoo BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'transmission': 'automatic',
 'trim': 'BEV 33KWH MAXI Z.E. B-BUY 5-SEATS',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980366%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Saving data for 1980366: {'auction_closing_time': 1774530000.0, 'created_time': 1774392762.481229, 'last_price_update_time': 1774479248.915708}
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980366') HTTP/1.1" 204 0
2026-03-25 22:54:08 [ayvens.be] INFO: Found listing with ID: 1980367
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980367%27 HTTP/1.1" 200 None
2026-03-25 22:54:08 [ayvens.be] INFO: Scrape type for 1980367: 2
2026-03-25 22:54:08 [ayvens.be] INFO: Extracting data for car ID: 1980367
2026-03-25 22:54:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-25 22:54:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 2
2026-03-25 22:54:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with scrape type 2
2026-03-25 22:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d, identifier: 1980367
2026-03-25 22:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-25 22:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367
2026-03-25 22:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 14f2b002-b2a6-542d-8ece-7cf9f9bede1d with identifier: 1980367 to the API
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '14f2b002-b2a6-542d-8ece-7cf9f9bede1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 179692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D MHEV ULTIMATE BRIGHT AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980367%27 HTTP/1.1" 200 None
2026-03-25 22:54:09 [ayvens.be] INFO: Saving data for 1980367: {'auction_closing_time': 1774530000.0, 'created_time': 1774392764.359146, 'last_price_update_time': 1774479249.29221}
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980367') HTTP/1.1" 204 0
2026-03-25 22:54:09 [ayvens.be] INFO: Found listing with ID: 1980368
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980368%27 HTTP/1.1" 200 None
2026-03-25 22:54:09 [ayvens.be] INFO: Scrape type for 1980368: 2
2026-03-25 22:54:09 [ayvens.be] INFO: Extracting data for car ID: 1980368
2026-03-25 22:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-25 22:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 2
2026-03-25 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc82ec7-e1b1-591a-80b6-4f56857b498c with scrape type 2
2026-03-25 22:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ffc82ec7-e1b1-591a-80b6-4f56857b498c, identifier: 1980368
2026-03-25 22:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-25 22:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368
2026-03-25 22:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ffc82ec7-e1b1-591a-80b6-4f56857b498c with identifier: 1980368 to the API
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ffc82ec7-e1b1-591a-80b6-4f56857b498c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 149760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980368%27 HTTP/1.1" 200 None
2026-03-25 22:54:09 [ayvens.be] INFO: Saving data for 1980368: {'auction_closing_time': 1774530000.0, 'created_time': 1774392765.874915, 'last_price_update_time': 1774479249.663929}
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980368') HTTP/1.1" 204 0
2026-03-25 22:54:09 [ayvens.be] INFO: Found listing with ID: 1980369
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980369%27 HTTP/1.1" 200 None
2026-03-25 22:54:09 [ayvens.be] INFO: Scrape type for 1980369: 2
2026-03-25 22:54:09 [ayvens.be] INFO: Extracting data for car ID: 1980369
2026-03-25 22:54:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-25 22:54:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 2
2026-03-25 22:54:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807845ce-938b-5149-aef8-3b7658af3e71 with scrape type 2
2026-03-25 22:54:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 807845ce-938b-5149-aef8-3b7658af3e71, identifier: 1980369
2026-03-25 22:54:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-25 22:54:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369
2026-03-25 22:54:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 807845ce-938b-5149-aef8-3b7658af3e71 with identifier: 1980369 to the API
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '807845ce-938b-5149-aef8-3b7658af3e71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 74611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW TITANIUM AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980369%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Saving data for 1980369: {'auction_closing_time': 1774530000.0, 'created_time': 1774392767.560011, 'last_price_update_time': 1774479250.032249}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980369') HTTP/1.1" 204 0
2026-03-25 22:54:10 [ayvens.be] INFO: Found listing with ID: 1980370
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980370%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Scrape type for 1980370: 2
2026-03-25 22:54:10 [ayvens.be] INFO: Extracting data for car ID: 1980370
2026-03-25 22:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-25 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417, identifier: 1980370
2026-03-25 22:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-25 22:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370
2026-03-25 22:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b8c7c7c-c02d-5ba0-acb4-cd5073322417 with identifier: 1980370 to the API
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b8c7c7c-c02d-5ba0-acb4-cd5073322417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 43166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980370%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Saving data for 1980370: {'auction_closing_time': 1774530000.0, 'created_time': 1774392768.946132, 'last_price_update_time': 1774479250.501588}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980370') HTTP/1.1" 204 0
2026-03-25 22:54:10 [ayvens.be] INFO: Found listing with ID: 1980371
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980371%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Scrape type for 1980371: 2
2026-03-25 22:54:10 [ayvens.be] INFO: Extracting data for car ID: 1980371
2026-03-25 22:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-25 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b68131d5-3bb8-563a-a9f7-13cf7d85e87d with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b68131d5-3bb8-563a-a9f7-13cf7d85e87d, identifier: 1980371
2026-03-25 22:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-25 22:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371
2026-03-25 22:54:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b68131d5-3bb8-563a-a9f7-13cf7d85e87d with identifier: 1980371 to the API
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b68131d5-3bb8-563a-a9f7-13cf7d85e87d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 173866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980371%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Saving data for 1980371: {'auction_closing_time': 1774530000.0, 'created_time': 1774392770.526023, 'last_price_update_time': 1774479250.877066}
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980371') HTTP/1.1" 204 0
2026-03-25 22:54:10 [ayvens.be] INFO: Found listing with ID: 1980372
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980372%27 HTTP/1.1" 200 None
2026-03-25 22:54:10 [ayvens.be] INFO: Scrape type for 1980372: 2
2026-03-25 22:54:10 [ayvens.be] INFO: Extracting data for car ID: 1980372
2026-03-25 22:54:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-25 22:54:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with scrape type 2
2026-03-25 22:54:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1, identifier: 1980372
2026-03-25 22:54:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-25 22:54:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372
2026-03-25 22:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c226416-0ac9-5e76-b8df-1e2ae4911fb1 with identifier: 1980372 to the API
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '3c226416-0ac9-5e76-b8df-1e2ae4911fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 31143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980372%27 HTTP/1.1" 200 None
2026-03-25 22:54:11 [ayvens.be] INFO: Saving data for 1980372: {'auction_closing_time': 1774530000.0, 'created_time': 1774392772.14162, 'last_price_update_time': 1774479251.25564}
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980372') HTTP/1.1" 204 0
2026-03-25 22:54:11 [ayvens.be] INFO: Found listing with ID: 1980373
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980373%27 HTTP/1.1" 200 None
2026-03-25 22:54:11 [ayvens.be] INFO: Scrape type for 1980373: 2
2026-03-25 22:54:11 [ayvens.be] INFO: Extracting data for car ID: 1980373
2026-03-25 22:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-25 22:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 2
2026-03-25 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9c31b26-dc78-56c7-b825-76271aa2099c with scrape type 2
2026-03-25 22:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c9c31b26-dc78-56c7-b825-76271aa2099c, identifier: 1980373
2026-03-25 22:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-25 22:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373
2026-03-25 22:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c9c31b26-dc78-56c7-b825-76271aa2099c with identifier: 1980373 to the API
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9c31b26-dc78-56c7-b825-76271aa2099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 131190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980373%27 HTTP/1.1" 200 None
2026-03-25 22:54:11 [ayvens.be] INFO: Saving data for 1980373: {'auction_closing_time': 1774530000.0, 'created_time': 1774392774.466551, 'last_price_update_time': 1774479251.634969}
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980373') HTTP/1.1" 204 0
2026-03-25 22:54:11 [ayvens.be] INFO: Found listing with ID: 1980374
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980374%27 HTTP/1.1" 200 None
2026-03-25 22:54:11 [ayvens.be] INFO: Scrape type for 1980374: 2
2026-03-25 22:54:11 [ayvens.be] INFO: Extracting data for car ID: 1980374
2026-03-25 22:54:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-25 22:54:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d51ddfea-de2d-531f-a5db-5fc648154b9b with scrape type 2
2026-03-25 22:54:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d51ddfea-de2d-531f-a5db-5fc648154b9b with scrape type 2
2026-03-25 22:54:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d51ddfea-de2d-531f-a5db-5fc648154b9b, identifier: 1980374
2026-03-25 22:54:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-25 22:54:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:54:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374
2026-03-25 22:54:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d51ddfea-de2d-531f-a5db-5fc648154b9b with identifier: 1980374 to the API
2026-03-25 22:54:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'DENIMBLAUW',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd51ddfea-de2d-531f-a5db-5fc648154b9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A SEDAN DIESEL (V177)',
 'odometer': 105843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A SEDAN DIESEL (V177) A 180 d Business Solution',
 'transmission': 'manual',
 'trim': 'A 180 d Business Solution',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980374%27 HTTP/1.1" 200 None
2026-03-25 22:54:12 [ayvens.be] INFO: Saving data for 1980374: {'auction_closing_time': 1774530000.0, 'created_time': 1774392775.152654, 'last_price_update_time': 1774479252.154525}
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980374') HTTP/1.1" 204 0
2026-03-25 22:54:12 [ayvens.be] INFO: Found listing with ID: 1980375
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980375%27 HTTP/1.1" 200 None
2026-03-25 22:54:12 [ayvens.be] INFO: Scrape type for 1980375: 2
2026-03-25 22:54:12 [ayvens.be] INFO: Extracting data for car ID: 1980375
2026-03-25 22:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-25 22:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7efce468-dcf5-5358-b2a5-0e8924f61b90 with scrape type 2
2026-03-25 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7efce468-dcf5-5358-b2a5-0e8924f61b90 with scrape type 2
2026-03-25 22:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7efce468-dcf5-5358-b2a5-0e8924f61b90, identifier: 1980375
2026-03-25 22:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-25 22:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375
2026-03-25 22:54:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7efce468-dcf5-5358-b2a5-0e8924f61b90 with identifier: 1980375 to the API
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7efce468-dcf5-5358-b2a5-0e8924f61b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 50270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980375%27 HTTP/1.1" 200 None
2026-03-25 22:54:12 [ayvens.be] INFO: Saving data for 1980375: {'auction_closing_time': 1774530000.0, 'created_time': 1774392776.656777, 'last_price_update_time': 1774479252.780983}
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980375') HTTP/1.1" 204 0
2026-03-25 22:54:12 [ayvens.be] INFO: Found listing with ID: 1980376
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980376%27 HTTP/1.1" 200 None
2026-03-25 22:54:12 [ayvens.be] INFO: Scrape type for 1980376: 2
2026-03-25 22:54:12 [ayvens.be] INFO: Extracting data for car ID: 1980376
2026-03-25 22:54:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-25 22:54:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 2
2026-03-25 22:54:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5d7ca9d-9d34-50ce-9519-5cb713e3392e with scrape type 2
2026-03-25 22:54:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5d7ca9d-9d34-50ce-9519-5cb713e3392e, identifier: 1980376
2026-03-25 22:54:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-25 22:54:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376
2026-03-25 22:54:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b5d7ca9d-9d34-50ce-9519-5cb713e3392e with identifier: 1980376 to the API
2026-03-25 22:54:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b5d7ca9d-9d34-50ce-9519-5cb713e3392e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 81688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980376%27 HTTP/1.1" 200 None
2026-03-25 22:54:14 [ayvens.be] INFO: Saving data for 1980376: {'auction_closing_time': 1774530000.0, 'created_time': 1774392778.248721, 'last_price_update_time': 1774479254.036585}
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980376') HTTP/1.1" 204 0
2026-03-25 22:54:14 [ayvens.be] INFO: Found listing with ID: 1980377
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980377%27 HTTP/1.1" 200 None
2026-03-25 22:54:14 [ayvens.be] INFO: Scrape type for 1980377: 2
2026-03-25 22:54:14 [ayvens.be] INFO: Extracting data for car ID: 1980377
2026-03-25 22:54:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-25 22:54:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with scrape type 2
2026-03-25 22:54:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with scrape type 2
2026-03-25 22:54:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 359087fe-dc4a-5306-b0a4-fb864fbb6f43, identifier: 1980377
2026-03-25 22:54:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-25 22:54:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377
2026-03-25 22:54:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 359087fe-dc4a-5306-b0a4-fb864fbb6f43 with identifier: 1980377 to the API
2026-03-25 22:54:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '359087fe-dc4a-5306-b0a4-fb864fbb6f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'Mini',
 'odometer': 57023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Mini 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980377%27 HTTP/1.1" 200 None
2026-03-25 22:54:15 [ayvens.be] INFO: Saving data for 1980377: {'auction_closing_time': 1774530000.0, 'created_time': 1774392780.428313, 'last_price_update_time': 1774479255.339057}
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980377') HTTP/1.1" 204 0
2026-03-25 22:54:15 [ayvens.be] INFO: Found listing with ID: 1980378
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980378%27 HTTP/1.1" 200 None
2026-03-25 22:54:15 [ayvens.be] INFO: Scrape type for 1980378: 2
2026-03-25 22:54:15 [ayvens.be] INFO: Extracting data for car ID: 1980378
2026-03-25 22:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-25 22:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 2
2026-03-25 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 575acd25-7abc-59a1-b3eb-26695f75fd69 with scrape type 2
2026-03-25 22:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 575acd25-7abc-59a1-b3eb-26695f75fd69, identifier: 1980378
2026-03-25 22:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-25 22:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378
2026-03-25 22:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 575acd25-7abc-59a1-b3eb-26695f75fd69 with identifier: 1980378 to the API
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '575acd25-7abc-59a1-b3eb-26695f75fd69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 51428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTBACK',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980378%27 HTTP/1.1" 200 None
2026-03-25 22:54:15 [ayvens.be] INFO: Saving data for 1980378: {'auction_closing_time': 1774530000.0, 'created_time': 1774392781.272675, 'last_price_update_time': 1774479255.707605}
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980378') HTTP/1.1" 204 0
2026-03-25 22:54:15 [ayvens.be] INFO: Found listing with ID: 1980379
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980379%27 HTTP/1.1" 200 None
2026-03-25 22:54:15 [ayvens.be] INFO: Scrape type for 1980379: 2
2026-03-25 22:54:15 [ayvens.be] INFO: Extracting data for car ID: 1980379
2026-03-25 22:54:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-25 22:54:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09f8733-d950-5fcf-b34d-5f549d9c39ef with scrape type 2
2026-03-25 22:54:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e09f8733-d950-5fcf-b34d-5f549d9c39ef with scrape type 2
2026-03-25 22:54:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e09f8733-d950-5fcf-b34d-5f549d9c39ef, identifier: 1980379
2026-03-25 22:54:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-25 22:54:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379
2026-03-25 22:54:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e09f8733-d950-5fcf-b34d-5f549d9c39ef with identifier: 1980379 to the API
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e09f8733-d950-5fcf-b34d-5f549d9c39ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 59196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 128KW PRO BUSINESS',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 128KW PRO BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980379%27 HTTP/1.1" 200 None
2026-03-25 22:54:16 [ayvens.be] INFO: Saving data for 1980379: {'auction_closing_time': 1774530000.0, 'created_time': 1774392782.996347, 'last_price_update_time': 1774479256.08979}
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980379') HTTP/1.1" 204 0
2026-03-25 22:54:16 [ayvens.be] INFO: Found listing with ID: 1980380
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980380%27 HTTP/1.1" 200 None
2026-03-25 22:54:16 [ayvens.be] INFO: Scrape type for 1980380: 2
2026-03-25 22:54:16 [ayvens.be] INFO: Extracting data for car ID: 1980380
2026-03-25 22:54:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-25 22:54:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f48db72-1693-5c56-a9af-46403435bd2f with scrape type 2
2026-03-25 22:54:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f48db72-1693-5c56-a9af-46403435bd2f with scrape type 2
2026-03-25 22:54:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f48db72-1693-5c56-a9af-46403435bd2f, identifier: 1980380
2026-03-25 22:54:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-25 22:54:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380
2026-03-25 22:54:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f48db72-1693-5c56-a9af-46403435bd2f with identifier: 1980380 to the API
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '2f48db72-1693-5c56-a9af-46403435bd2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MAu2030GANE BERLINE',
 'odometer': 119557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MAu2030GANE BERLINE 1.5 BLUE DCI 115 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 115 CORPORATE EDITION',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980380%27 HTTP/1.1" 200 None
2026-03-25 22:54:16 [ayvens.be] INFO: Saving data for 1980380: {'auction_closing_time': 1774530000.0, 'created_time': 1774392785.236388, 'last_price_update_time': 1774479256.927113}
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980380') HTTP/1.1" 204 0
2026-03-25 22:54:17 [ayvens.be] INFO: Found listing with ID: 1980381
2026-03-25 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980381%27 HTTP/1.1" 200 None
2026-03-25 22:54:17 [ayvens.be] INFO: Scrape type for 1980381: 2
2026-03-25 22:54:17 [ayvens.be] INFO: Extracting data for car ID: 1980381
2026-03-25 22:54:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-25 22:54:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 2
2026-03-25 22:54:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f19dff6-09d0-5024-b64c-2157ab8048d4 with scrape type 2
2026-03-25 22:54:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7f19dff6-09d0-5024-b64c-2157ab8048d4, identifier: 1980381
2026-03-25 22:54:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-25 22:54:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381
2026-03-25 22:54:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7f19dff6-09d0-5024-b64c-2157ab8048d4 with identifier: 1980381 to the API
2026-03-25 22:54:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f19dff6-09d0-5024-b64c-2157ab8048d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 47509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 180 D BUS SOLUTION '
          'ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 CLA 180 D BUS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980381%27 HTTP/1.1" 200 None
2026-03-25 22:54:18 [ayvens.be] INFO: Saving data for 1980381: {'auction_closing_time': 1774530000.0, 'created_time': 1774392786.769782, 'last_price_update_time': 1774479258.276117}
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980381') HTTP/1.1" 204 0
2026-03-25 22:54:18 [ayvens.be] INFO: Found listing with ID: 1980382
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980382%27 HTTP/1.1" 200 None
2026-03-25 22:54:18 [ayvens.be] INFO: Scrape type for 1980382: 2
2026-03-25 22:54:18 [ayvens.be] INFO: Extracting data for car ID: 1980382
2026-03-25 22:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-25 22:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 2
2026-03-25 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with scrape type 2
2026-03-25 22:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380, identifier: 1980382
2026-03-25 22:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-25 22:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382
2026-03-25 22:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e2e328d8-b8fa-5e9a-aacc-ce7d1babb380 with identifier: 1980382 to the API
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e2e328d8-b8fa-5e9a-aacc-ce7d1babb380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 93476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-EAT8 BUS. LOUNGE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980382%27 HTTP/1.1" 200 None
2026-03-25 22:54:18 [ayvens.be] INFO: Saving data for 1980382: {'auction_closing_time': 1774530000.0, 'created_time': 1774392788.17621, 'last_price_update_time': 1774479258.656962}
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980382') HTTP/1.1" 204 0
2026-03-25 22:54:18 [ayvens.be] INFO: Found listing with ID: 1980383
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980383%27 HTTP/1.1" 200 None
2026-03-25 22:54:18 [ayvens.be] INFO: Scrape type for 1980383: 2
2026-03-25 22:54:18 [ayvens.be] INFO: Extracting data for car ID: 1980383
2026-03-25 22:54:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-25 22:54:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 2
2026-03-25 22:54:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with scrape type 2
2026-03-25 22:54:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d, identifier: 1980383
2026-03-25 22:54:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-25 22:54:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383
2026-03-25 22:54:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d with identifier: 1980383 to the API
2026-03-25 22:54:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '2bd0ccc6-48b2-55aa-9b1b-a5b93fac6f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 88931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS LINE',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS LINE',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980383%27 HTTP/1.1" 200 None
2026-03-25 22:54:20 [ayvens.be] INFO: Saving data for 1980383: {'auction_closing_time': 1774530000.0, 'created_time': 1774392789.7293, 'last_price_update_time': 1774479260.045108}
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980383') HTTP/1.1" 204 0
2026-03-25 22:54:20 [ayvens.be] INFO: Found listing with ID: 1980384
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980384%27 HTTP/1.1" 200 None
2026-03-25 22:54:20 [ayvens.be] INFO: Scrape type for 1980384: 2
2026-03-25 22:54:20 [ayvens.be] INFO: Extracting data for car ID: 1980384
2026-03-25 22:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-25 22:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 2
2026-03-25 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b09540-2cfa-59a3-bcbe-719968d86e7f with scrape type 2
2026-03-25 22:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44b09540-2cfa-59a3-bcbe-719968d86e7f, identifier: 1980384
2026-03-25 22:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-25 22:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384
2026-03-25 22:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44b09540-2cfa-59a3-bcbe-719968d86e7f with identifier: 1980384 to the API
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '44b09540-2cfa-59a3-bcbe-719968d86e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 SPORTBACK E-TRON',
 'odometer': 13316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 SPORTBACK E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2024}
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980384%27 HTTP/1.1" 200 None
2026-03-25 22:54:20 [ayvens.be] INFO: Saving data for 1980384: {'auction_closing_time': 1774530000.0, 'created_time': 1774392798.611749, 'last_price_update_time': 1774479260.44019}
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980384') HTTP/1.1" 204 0
2026-03-25 22:54:20 [ayvens.be] INFO: Found listing with ID: 1980385
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980385%27 HTTP/1.1" 200 None
2026-03-25 22:54:20 [ayvens.be] INFO: Scrape type for 1980385: 2
2026-03-25 22:54:20 [ayvens.be] INFO: Extracting data for car ID: 1980385
2026-03-25 22:54:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-25 22:54:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 2
2026-03-25 22:54:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99c16ce4-23e7-5da6-9da3-86696de860c7 with scrape type 2
2026-03-25 22:54:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 99c16ce4-23e7-5da6-9da3-86696de860c7, identifier: 1980385
2026-03-25 22:54:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-25 22:54:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385
2026-03-25 22:54:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 99c16ce4-23e7-5da6-9da3-86696de860c7 with identifier: 1980385 to the API
2026-03-25 22:54:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '99c16ce4-23e7-5da6-9da3-86696de860c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 20854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980385%27 HTTP/1.1" 200 None
2026-03-25 22:54:21 [ayvens.be] INFO: Saving data for 1980385: {'auction_closing_time': 1774530000.0, 'created_time': 1774392795.21744, 'last_price_update_time': 1774479261.844273}
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980385') HTTP/1.1" 204 0
2026-03-25 22:54:21 [ayvens.be] INFO: Found listing with ID: 1980386
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980386%27 HTTP/1.1" 200 None
2026-03-25 22:54:21 [ayvens.be] INFO: Scrape type for 1980386: 2
2026-03-25 22:54:21 [ayvens.be] INFO: Extracting data for car ID: 1980386
2026-03-25 22:54:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-25 22:54:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 2
2026-03-25 22:54:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32502b7-c4ac-5350-8b50-67b8224804a5 with scrape type 2
2026-03-25 22:54:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f32502b7-c4ac-5350-8b50-67b8224804a5, identifier: 1980386
2026-03-25 22:54:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-25 22:54:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:54:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:54:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386
2026-03-25 22:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f32502b7-c4ac-5350-8b50-67b8224804a5 with identifier: 1980386 to the API
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f32502b7-c4ac-5350-8b50-67b8224804a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 175679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 SDRIVE18D (110KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18D (110KW) AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980386%27 HTTP/1.1" 200 None
2026-03-25 22:54:22 [ayvens.be] INFO: Saving data for 1980386: {'auction_closing_time': 1774530000.0, 'created_time': 1774392797.340656, 'last_price_update_time': 1774479262.220489}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980386') HTTP/1.1" 204 0
2026-03-25 22:54:22 [ayvens.be] INFO: Found listing with ID: 1980387
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980387%27 HTTP/1.1" 200 None
2026-03-25 22:54:22 [ayvens.be] INFO: Scrape type for 1980387: 2
2026-03-25 22:54:22 [ayvens.be] INFO: Extracting data for car ID: 1980387
2026-03-25 22:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-25 22:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 2
2026-03-25 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f7ee486-8742-5e66-b3be-58363099d735 with scrape type 2
2026-03-25 22:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1f7ee486-8742-5e66-b3be-58363099d735, identifier: 1980387
2026-03-25 22:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-25 22:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387
2026-03-25 22:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1f7ee486-8742-5e66-b3be-58363099d735 with identifier: 1980387 to the API
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1f7ee486-8742-5e66-b3be-58363099d735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 114773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T5 RECHARGE GEARTR. INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980387%27 HTTP/1.1" 200 None
2026-03-25 22:54:22 [ayvens.be] INFO: Saving data for 1980387: {'auction_closing_time': 1774530000.0, 'created_time': 1774392796.418993, 'last_price_update_time': 1774479262.601505}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980387') HTTP/1.1" 204 0
2026-03-25 22:54:22 [ayvens.be] INFO: Found listing with ID: 1980388
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980388%27 HTTP/1.1" 200 None
2026-03-25 22:54:22 [ayvens.be] INFO: Scrape type for 1980388: 2
2026-03-25 22:54:22 [ayvens.be] INFO: Extracting data for car ID: 1980388
2026-03-25 22:54:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-25 22:54:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 2
2026-03-25 22:54:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3059e2-656c-5e69-aca5-e764afd132b2 with scrape type 2
2026-03-25 22:54:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be3059e2-656c-5e69-aca5-e764afd132b2, identifier: 1980388
2026-03-25 22:54:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-25 22:54:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388
2026-03-25 22:54:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be3059e2-656c-5e69-aca5-e764afd132b2 with identifier: 1980388 to the API
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'be3059e2-656c-5e69-aca5-e764afd132b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 124353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980388%27 HTTP/1.1" 200 None
2026-03-25 22:54:22 [ayvens.be] INFO: Saving data for 1980388: {'auction_closing_time': 1774530000.0, 'created_time': 1774392800.435845, 'last_price_update_time': 1774479262.9812}
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980388') HTTP/1.1" 204 0
2026-03-25 22:54:22 [ayvens.be] INFO: Found listing with ID: 1980389
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980389%27 HTTP/1.1" 200 None
2026-03-25 22:54:23 [ayvens.be] INFO: Scrape type for 1980389: 2
2026-03-25 22:54:23 [ayvens.be] INFO: Extracting data for car ID: 1980389
2026-03-25 22:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-25 22:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e61c9470-165e-5a83-aef1-7e0b32965a70 with scrape type 2
2026-03-25 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e61c9470-165e-5a83-aef1-7e0b32965a70 with scrape type 2
2026-03-25 22:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e61c9470-165e-5a83-aef1-7e0b32965a70, identifier: 1980389
2026-03-25 22:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-25 22:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389
2026-03-25 22:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e61c9470-165e-5a83-aef1-7e0b32965a70 with identifier: 1980389 to the API
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e61c9470-165e-5a83-aef1-7e0b32965a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-5 DIESEL - 2017',
 'odometer': 113138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-5 DIESEL - 2017 2.2 SKY-D 4WD Skycruise Takumi (EU6d-T)',
 'transmission': 'manual',
 'trim': '2.2 SKY-D 4WD Skycruise Takumi (EU6d-T)',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980389%27 HTTP/1.1" 200 None
2026-03-25 22:54:23 [ayvens.be] INFO: Saving data for 1980389: {'auction_closing_time': 1774530000.0, 'created_time': 1774392803.173319, 'last_price_update_time': 1774479263.367782}
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980389') HTTP/1.1" 204 0
2026-03-25 22:54:23 [ayvens.be] INFO: Found listing with ID: 1980390
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980390%27 HTTP/1.1" 200 None
2026-03-25 22:54:23 [ayvens.be] INFO: Scrape type for 1980390: 2
2026-03-25 22:54:23 [ayvens.be] INFO: Extracting data for car ID: 1980390
2026-03-25 22:54:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-25 22:54:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 2
2026-03-25 22:54:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973b0b30-ae16-5993-8445-749a81894b5c with scrape type 2
2026-03-25 22:54:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 973b0b30-ae16-5993-8445-749a81894b5c, identifier: 1980390
2026-03-25 22:54:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-25 22:54:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390
2026-03-25 22:54:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 973b0b30-ae16-5993-8445-749a81894b5c with identifier: 1980390 to the API
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '973b0b30-ae16-5993-8445-749a81894b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 128196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 2.5I PHEV 165KW ST-LINE X AUTO',
 'transmission': 'automatic',
 'trim': '2.5I PHEV 165KW ST-LINE X AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980390%27 HTTP/1.1" 200 None
2026-03-25 22:54:23 [ayvens.be] INFO: Saving data for 1980390: {'auction_closing_time': 1774530000.0, 'created_time': 1774392820.984475, 'last_price_update_time': 1774479263.972265}
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980390') HTTP/1.1" 204 0
2026-03-25 22:54:23 [ayvens.be] INFO: Found listing with ID: 1980391
2026-03-25 22:54:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980391%27 HTTP/1.1" 200 None
2026-03-25 22:54:24 [ayvens.be] INFO: Scrape type for 1980391: 2
2026-03-25 22:54:24 [ayvens.be] INFO: Extracting data for car ID: 1980391
2026-03-25 22:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-25 22:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc, identifier: 1980391
2026-03-25 22:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-25 22:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391
2026-03-25 22:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 555f67f7-ee2f-5c9f-8fd6-24113fff47fc with identifier: 1980391 to the API
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '555f67f7-ee2f-5c9f-8fd6-24113fff47fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 80415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 SDRIVE18I 100KW',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE18I 100KW',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980391%27 HTTP/1.1" 200 None
2026-03-25 22:54:24 [ayvens.be] INFO: Saving data for 1980391: {'auction_closing_time': 1774530000.0, 'created_time': 1774392807.204635, 'last_price_update_time': 1774479264.361991}
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980391') HTTP/1.1" 204 0
2026-03-25 22:54:24 [ayvens.be] INFO: Found listing with ID: 1980392
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980392%27 HTTP/1.1" 200 None
2026-03-25 22:54:24 [ayvens.be] INFO: Scrape type for 1980392: 2
2026-03-25 22:54:24 [ayvens.be] INFO: Extracting data for car ID: 1980392
2026-03-25 22:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-25 22:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86223df2-a655-5ba1-8ef4-a3eea7e1c134, identifier: 1980392
2026-03-25 22:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-25 22:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392
2026-03-25 22:54:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86223df2-a655-5ba1-8ef4-a3eea7e1c134 with identifier: 1980392 to the API
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '86223df2-a655-5ba1-8ef4-a3eea7e1c134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 214066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'transmission': 'automatic',
 'trim': '1.5 T5 PHEV PLUS BRIGHT DESIGN DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980392%27 HTTP/1.1" 200 None
2026-03-25 22:54:24 [ayvens.be] INFO: Saving data for 1980392: {'auction_closing_time': 1774530000.0, 'created_time': 1774392805.90292, 'last_price_update_time': 1774479264.832647}
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980392') HTTP/1.1" 204 0
2026-03-25 22:54:24 [ayvens.be] INFO: Found listing with ID: 1980393
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980393%27 HTTP/1.1" 200 None
2026-03-25 22:54:24 [ayvens.be] INFO: Scrape type for 1980393: 2
2026-03-25 22:54:24 [ayvens.be] INFO: Extracting data for car ID: 1980393
2026-03-25 22:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-25 22:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with scrape type 2
2026-03-25 22:54:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d, identifier: 1980393
2026-03-25 22:54:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-25 22:54:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393
2026-03-25 22:54:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d with identifier: 1980393 to the API
2026-03-25 22:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4727e590-88f7-5f61-9f1d-0bc6c9ad3a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 87175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'transmission': 'automatic',
 'trim': '1.0 ECOBOOST MHEV 92KW DCT ST-LINE X',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980393%27 HTTP/1.1" 200 None
2026-03-25 22:54:26 [ayvens.be] INFO: Saving data for 1980393: {'auction_closing_time': 1774530000.0, 'created_time': 1774392809.290373, 'last_price_update_time': 1774479266.194263}
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980393') HTTP/1.1" 204 0
2026-03-25 22:54:26 [ayvens.be] INFO: Found listing with ID: 1980394
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980394%27 HTTP/1.1" 200 None
2026-03-25 22:54:26 [ayvens.be] INFO: Scrape type for 1980394: 2
2026-03-25 22:54:26 [ayvens.be] INFO: Extracting data for car ID: 1980394
2026-03-25 22:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-25 22:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 2
2026-03-25 22:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df095015-0ccb-5f99-b189-ce5e41de1ee3 with scrape type 2
2026-03-25 22:54:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df095015-0ccb-5f99-b189-ce5e41de1ee3, identifier: 1980394
2026-03-25 22:54:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-25 22:54:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394
2026-03-25 22:54:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df095015-0ccb-5f99-b189-ce5e41de1ee3 with identifier: 1980394 to the API
2026-03-25 22:54:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df095015-0ccb-5f99-b189-ce5e41de1ee3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT GTE - 2020',
 'odometer': 92656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT GTE - 2020 1.4 TSI PHEV GTE Business DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE Business DSG',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980394%27 HTTP/1.1" 200 None
2026-03-25 22:54:27 [ayvens.be] INFO: Saving data for 1980394: {'auction_closing_time': 1774530000.0, 'created_time': 1774392815.641581, 'last_price_update_time': 1774479267.621801}
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980394') HTTP/1.1" 204 0
2026-03-25 22:54:27 [ayvens.be] INFO: Found listing with ID: 1980395
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980395%27 HTTP/1.1" 200 None
2026-03-25 22:54:27 [ayvens.be] INFO: Scrape type for 1980395: 2
2026-03-25 22:54:27 [ayvens.be] INFO: Extracting data for car ID: 1980395
2026-03-25 22:54:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-25 22:54:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 2
2026-03-25 22:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceb1d629-df7b-58ce-aa91-9dee573cbb0d with scrape type 2
2026-03-25 22:54:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ceb1d629-df7b-58ce-aa91-9dee573cbb0d, identifier: 1980395
2026-03-25 22:54:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-25 22:54:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395
2026-03-25 22:54:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ceb1d629-df7b-58ce-aa91-9dee573cbb0d with identifier: 1980395 to the API
2026-03-25 22:54:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ceb1d629-df7b-58ce-aa91-9dee573cbb0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 82333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980395%27 HTTP/1.1" 200 None
2026-03-25 22:54:28 [ayvens.be] INFO: Saving data for 1980395: {'auction_closing_time': 1774530000.0, 'created_time': 1774392812.937874, 'last_price_update_time': 1774479268.88778}
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980395') HTTP/1.1" 204 0
2026-03-25 22:54:28 [ayvens.be] INFO: Found listing with ID: 1980396
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980396%27 HTTP/1.1" 200 None
2026-03-25 22:54:28 [ayvens.be] INFO: Scrape type for 1980396: 2
2026-03-25 22:54:28 [ayvens.be] INFO: Extracting data for car ID: 1980396
2026-03-25 22:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-25 22:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 2
2026-03-25 22:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with scrape type 2
2026-03-25 22:54:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4, identifier: 1980396
2026-03-25 22:54:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-25 22:54:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396
2026-03-25 22:54:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d509a2bd-3224-5aa1-a4e3-43f55bb7adc4 with identifier: 1980396 to the API
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd509a2bd-3224-5aa1-a4e3-43f55bb7adc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 150951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318D (100KW) TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318D (100KW) TOURING',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980396%27 HTTP/1.1" 200 None
2026-03-25 22:54:29 [ayvens.be] INFO: Saving data for 1980396: {'auction_closing_time': 1774530000.0, 'created_time': 1774392813.336512, 'last_price_update_time': 1774479269.959842}
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980396') HTTP/1.1" 204 0
2026-03-25 22:54:29 [ayvens.be] INFO: Found listing with ID: 1980397
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980397%27 HTTP/1.1" 200 None
2026-03-25 22:54:29 [ayvens.be] INFO: Scrape type for 1980397: 2
2026-03-25 22:54:29 [ayvens.be] INFO: Extracting data for car ID: 1980397
2026-03-25 22:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-25 22:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with scrape type 2
2026-03-25 22:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with scrape type 2
2026-03-25 22:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b6d818fd-62ee-53d1-9d5d-90cebd6700d9, identifier: 1980397
2026-03-25 22:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-25 22:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397
2026-03-25 22:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b6d818fd-62ee-53d1-9d5d-90cebd6700d9 with identifier: 1980397 to the API
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b6d818fd-62ee-53d1-9d5d-90cebd6700d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT VIII',
 'odometer': 104359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT VIII 1.0 TSI 81KW LIFE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW LIFE',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980397%27 HTTP/1.1" 200 None
2026-03-25 22:54:30 [ayvens.be] INFO: Saving data for 1980397: {'auction_closing_time': 1774530000.0, 'created_time': 1774392815.130066, 'last_price_update_time': 1774479270.320484}
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980397') HTTP/1.1" 204 0
2026-03-25 22:54:30 [ayvens.be] INFO: Found listing with ID: 1980398
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980398%27 HTTP/1.1" 200 None
2026-03-25 22:54:30 [ayvens.be] INFO: Scrape type for 1980398: 2
2026-03-25 22:54:30 [ayvens.be] INFO: Extracting data for car ID: 1980398
2026-03-25 22:54:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-25 22:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b with scrape type 2
2026-03-25 22:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca90ab55-b05f-59cb-8ca9-e100eed25e9b with scrape type 2
2026-03-25 22:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca90ab55-b05f-59cb-8ca9-e100eed25e9b, identifier: 1980398
2026-03-25 22:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-25 22:54:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398
2026-03-25 22:54:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca90ab55-b05f-59cb-8ca9-e100eed25e9b with identifier: 1980398 to the API
2026-03-25 22:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ca90ab55-b05f-59cb-8ca9-e100eed25e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 77826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.2 PURETECH 130 BUSINESS GPS',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 BUSINESS GPS',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980398%27 HTTP/1.1" 200 None
2026-03-25 22:54:31 [ayvens.be] INFO: Saving data for 1980398: {'auction_closing_time': 1774530000.0, 'created_time': 1774392816.208718, 'last_price_update_time': 1774479271.390818}
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980398') HTTP/1.1" 204 0
2026-03-25 22:54:31 [ayvens.be] INFO: Found listing with ID: 1980399
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980399%27 HTTP/1.1" 200 None
2026-03-25 22:54:31 [ayvens.be] INFO: Scrape type for 1980399: 2
2026-03-25 22:54:31 [ayvens.be] INFO: Extracting data for car ID: 1980399
2026-03-25 22:54:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-25 22:54:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 2
2026-03-25 22:54:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eed05e3d-f763-50bb-8774-2ad0b64eac8d with scrape type 2
2026-03-25 22:54:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eed05e3d-f763-50bb-8774-2ad0b64eac8d, identifier: 1980399
2026-03-25 22:54:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-25 22:54:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399
2026-03-25 22:54:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eed05e3d-f763-50bb-8774-2ad0b64eac8d with identifier: 1980399 to the API
2026-03-25 22:54:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eed05e3d-f763-50bb-8774-2ad0b64eac8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 81231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980399%27 HTTP/1.1" 200 None
2026-03-25 22:54:32 [ayvens.be] INFO: Saving data for 1980399: {'auction_closing_time': 1774530000.0, 'created_time': 1774392818.138905, 'last_price_update_time': 1774479272.247659}
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980399') HTTP/1.1" 204 0
2026-03-25 22:54:32 [ayvens.be] INFO: Found listing with ID: 1980400
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980400%27 HTTP/1.1" 200 None
2026-03-25 22:54:32 [ayvens.be] INFO: Scrape type for 1980400: 2
2026-03-25 22:54:32 [ayvens.be] INFO: Extracting data for car ID: 1980400
2026-03-25 22:54:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-25 22:54:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 2
2026-03-25 22:54:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43bfe296-351d-5e28-8a25-5f5aae11d602 with scrape type 2
2026-03-25 22:54:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43bfe296-351d-5e28-8a25-5f5aae11d602, identifier: 1980400
2026-03-25 22:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-25 22:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400
2026-03-25 22:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 43bfe296-351d-5e28-8a25-5f5aae11d602 with identifier: 1980400 to the API
2026-03-25 22:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '43bfe296-351d-5e28-8a25-5f5aae11d602',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 53332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980400%27 HTTP/1.1" 200 None
2026-03-25 22:54:33 [ayvens.be] INFO: Saving data for 1980400: {'auction_closing_time': 1774530000.0, 'created_time': 1774392820.108768, 'last_price_update_time': 1774479273.320239}
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980400') HTTP/1.1" 204 0
2026-03-25 22:54:33 [ayvens.be] INFO: Found listing with ID: 1980401
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980401%27 HTTP/1.1" 200 None
2026-03-25 22:54:33 [ayvens.be] INFO: Scrape type for 1980401: 2
2026-03-25 22:54:33 [ayvens.be] INFO: Extracting data for car ID: 1980401
2026-03-25 22:54:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-25 22:54:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 2
2026-03-25 22:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d83f80e-b981-55eb-ba32-3dbbda630b16 with scrape type 2
2026-03-25 22:54:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d83f80e-b981-55eb-ba32-3dbbda630b16, identifier: 1980401
2026-03-25 22:54:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-25 22:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401
2026-03-25 22:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d83f80e-b981-55eb-ba32-3dbbda630b16 with identifier: 1980401 to the API
2026-03-25 22:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '7d83f80e-b981-55eb-ba32-3dbbda630b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 61618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980401%27 HTTP/1.1" 200 None
2026-03-25 22:54:35 [ayvens.be] INFO: Saving data for 1980401: {'auction_closing_time': 1774530000.0, 'created_time': 1774392833.567894, 'last_price_update_time': 1774479275.022514}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980401') HTTP/1.1" 204 0
2026-03-25 22:54:35 [ayvens.be] INFO: Found listing with ID: 1980402
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980402%27 HTTP/1.1" 200 None
2026-03-25 22:54:35 [ayvens.be] INFO: Scrape type for 1980402: 2
2026-03-25 22:54:35 [ayvens.be] INFO: Extracting data for car ID: 1980402
2026-03-25 22:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-25 22:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 2
2026-03-25 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3f96dd9-a309-5d3d-b9f0-8186628076bd with scrape type 2
2026-03-25 22:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3f96dd9-a309-5d3d-b9f0-8186628076bd, identifier: 1980402
2026-03-25 22:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-25 22:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402
2026-03-25 22:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b3f96dd9-a309-5d3d-b9f0-8186628076bd with identifier: 1980402 to the API
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b3f96dd9-a309-5d3d-b9f0-8186628076bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 50581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980402%27 HTTP/1.1" 200 None
2026-03-25 22:54:35 [ayvens.be] INFO: Saving data for 1980402: {'auction_closing_time': 1774530000.0, 'created_time': 1774392827.888634, 'last_price_update_time': 1774479275.40848}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980402') HTTP/1.1" 204 0
2026-03-25 22:54:35 [ayvens.be] INFO: Found listing with ID: 1980403
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980403%27 HTTP/1.1" 200 None
2026-03-25 22:54:35 [ayvens.be] INFO: Scrape type for 1980403: 2
2026-03-25 22:54:35 [ayvens.be] INFO: Extracting data for car ID: 1980403
2026-03-25 22:54:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-25 22:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 2
2026-03-25 22:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02602273-374d-59c0-8940-51e50b8740ed with scrape type 2
2026-03-25 22:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02602273-374d-59c0-8940-51e50b8740ed, identifier: 1980403
2026-03-25 22:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-25 22:54:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403
2026-03-25 22:54:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 02602273-374d-59c0-8940-51e50b8740ed with identifier: 1980403 to the API
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '02602273-374d-59c0-8940-51e50b8740ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 150035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI 120KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980403%27 HTTP/1.1" 200 None
2026-03-25 22:54:35 [ayvens.be] INFO: Saving data for 1980403: {'auction_closing_time': 1774530000.0, 'created_time': 1774392826.081379, 'last_price_update_time': 1774479275.988856}
2026-03-25 22:54:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980403') HTTP/1.1" 204 0
2026-03-25 22:54:36 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-03-25 22:54:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:54:38 [ayvens.be] INFO: Found listing with ID: 1980404
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980404%27 HTTP/1.1" 200 None
2026-03-25 22:54:38 [ayvens.be] INFO: Scrape type for 1980404: 2
2026-03-25 22:54:38 [ayvens.be] INFO: Extracting data for car ID: 1980404
2026-03-25 22:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-25 22:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09913203-b771-5629-8a71-b1fb2bdfa726 with scrape type 2
2026-03-25 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09913203-b771-5629-8a71-b1fb2bdfa726 with scrape type 2
2026-03-25 22:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09913203-b771-5629-8a71-b1fb2bdfa726, identifier: 1980404
2026-03-25 22:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-25 22:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404
2026-03-25 22:54:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09913203-b771-5629-8a71-b1fb2bdfa726 with identifier: 1980404 to the API
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '09913203-b771-5629-8a71-b1fb2bdfa726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 GRAN TOURER DIESEL - 2018',
 'odometer': 46905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2 GRAN TOURER DIESEL - 2018 216 dA AdBlue',
 'transmission': 'automatic',
 'trim': '216 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980404%27 HTTP/1.1" 200 None
2026-03-25 22:54:38 [ayvens.be] INFO: Saving data for 1980404: {'auction_closing_time': 1774530000.0, 'created_time': 1774392824.843048, 'last_price_update_time': 1774479278.820817}
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980404') HTTP/1.1" 204 0
2026-03-25 22:54:38 [ayvens.be] INFO: Found listing with ID: 1980405
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980405%27 HTTP/1.1" 200 None
2026-03-25 22:54:38 [ayvens.be] INFO: Scrape type for 1980405: 2
2026-03-25 22:54:38 [ayvens.be] INFO: Extracting data for car ID: 1980405
2026-03-25 22:54:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-25 22:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 2
2026-03-25 22:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0980ad47-8713-5737-b72e-7ea91ca5aa84 with scrape type 2
2026-03-25 22:54:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0980ad47-8713-5737-b72e-7ea91ca5aa84, identifier: 1980405
2026-03-25 22:54:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-25 22:54:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405
2026-03-25 22:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0980ad47-8713-5737-b72e-7ea91ca5aa84 with identifier: 1980405 to the API
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '0980ad47-8713-5737-b72e-7ea91ca5aa84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 106979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980405%27 HTTP/1.1" 200 None
2026-03-25 22:54:39 [ayvens.be] INFO: Saving data for 1980405: {'auction_closing_time': 1774530000.0, 'created_time': 1774392828.546752, 'last_price_update_time': 1774479279.225306}
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980405') HTTP/1.1" 204 0
2026-03-25 22:54:39 [ayvens.be] INFO: Found listing with ID: 1980406
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980406%27 HTTP/1.1" 200 None
2026-03-25 22:54:39 [ayvens.be] INFO: Scrape type for 1980406: 2
2026-03-25 22:54:39 [ayvens.be] INFO: Extracting data for car ID: 1980406
2026-03-25 22:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-25 22:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df23f13-e0ca-55cb-8368-423e6982df03 with scrape type 2
2026-03-25 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3df23f13-e0ca-55cb-8368-423e6982df03 with scrape type 2
2026-03-25 22:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3df23f13-e0ca-55cb-8368-423e6982df03, identifier: 1980406
2026-03-25 22:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-25 22:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406
2026-03-25 22:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3df23f13-e0ca-55cb-8368-423e6982df03 with identifier: 1980406 to the API
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '3df23f13-e0ca-55cb-8368-423e6982df03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 172637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 SDRIVE18D (100KW)',
 'transmission': 'manual',
 'trim': '2.0 SDRIVE18D (100KW)',
 'vin': None,
 'year': 2019}
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980406%27 HTTP/1.1" 200 None
2026-03-25 22:54:39 [ayvens.be] INFO: Saving data for 1980406: {'auction_closing_time': 1774530000.0, 'created_time': 1774392830.492646, 'last_price_update_time': 1774479279.629194}
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980406') HTTP/1.1" 204 0
2026-03-25 22:54:39 [ayvens.be] INFO: Found listing with ID: 1980407
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980407%27 HTTP/1.1" 200 None
2026-03-25 22:54:39 [ayvens.be] INFO: Scrape type for 1980407: 2
2026-03-25 22:54:39 [ayvens.be] INFO: Extracting data for car ID: 1980407
2026-03-25 22:54:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-25 22:54:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 2
2026-03-25 22:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 966881a6-57ad-58a3-8bb5-1938c5357336 with scrape type 2
2026-03-25 22:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 966881a6-57ad-58a3-8bb5-1938c5357336, identifier: 1980407
2026-03-25 22:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-25 22:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407
2026-03-25 22:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 966881a6-57ad-58a3-8bb5-1938c5357336 with identifier: 1980407 to the API
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '966881a6-57ad-58a3-8bb5-1938c5357336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 48870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980407%27 HTTP/1.1" 200 None
2026-03-25 22:54:39 [ayvens.be] INFO: Saving data for 1980407: {'auction_closing_time': 1774530000.0, 'created_time': 1774392831.83873, 'last_price_update_time': 1774479279.995787}
2026-03-25 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980407') HTTP/1.1" 204 0
2026-03-25 22:54:40 [ayvens.be] INFO: Found listing with ID: 1980408
2026-03-25 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980408%27 HTTP/1.1" 200 None
2026-03-25 22:54:40 [ayvens.be] INFO: Scrape type for 1980408: 2
2026-03-25 22:54:40 [ayvens.be] INFO: Extracting data for car ID: 1980408
2026-03-25 22:54:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-25 22:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 2
2026-03-25 22:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c41590c-6777-5c3e-bdc0-3649b66068c8 with scrape type 2
2026-03-25 22:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c41590c-6777-5c3e-bdc0-3649b66068c8, identifier: 1980408
2026-03-25 22:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-25 22:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408
2026-03-25 22:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c41590c-6777-5c3e-bdc0-3649b66068c8 with identifier: 1980408 to the API
2026-03-25 22:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c41590c-6777-5c3e-bdc0-3649b66068c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 70763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980408%27 HTTP/1.1" 200 None
2026-03-25 22:54:41 [ayvens.be] INFO: Saving data for 1980408: {'auction_closing_time': 1774530000.0, 'created_time': 1774392833.89063, 'last_price_update_time': 1774479281.398776}
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980408') HTTP/1.1" 204 0
2026-03-25 22:54:41 [ayvens.be] INFO: Found listing with ID: 1980409
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980409%27 HTTP/1.1" 200 None
2026-03-25 22:54:41 [ayvens.be] INFO: Scrape type for 1980409: 2
2026-03-25 22:54:41 [ayvens.be] INFO: Extracting data for car ID: 1980409
2026-03-25 22:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-25 22:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 2
2026-03-25 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f562b3c3-4465-58af-bad1-2ced11145b8e with scrape type 2
2026-03-25 22:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f562b3c3-4465-58af-bad1-2ced11145b8e, identifier: 1980409
2026-03-25 22:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-25 22:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409
2026-03-25 22:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f562b3c3-4465-58af-bad1-2ced11145b8e with identifier: 1980409 to the API
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f562b3c3-4465-58af-bad1-2ced11145b8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 107173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 PHEV 225 E-AUTO GT',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO GT',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980409%27 HTTP/1.1" 200 None
2026-03-25 22:54:41 [ayvens.be] INFO: Saving data for 1980409: {'auction_closing_time': 1774530000.0, 'created_time': 1774392835.180712, 'last_price_update_time': 1774479281.829078}
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980409') HTTP/1.1" 204 0
2026-03-25 22:54:41 [ayvens.be] INFO: Found listing with ID: 1980410
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980410%27 HTTP/1.1" 200 None
2026-03-25 22:54:41 [ayvens.be] INFO: Scrape type for 1980410: 2
2026-03-25 22:54:41 [ayvens.be] INFO: Extracting data for car ID: 1980410
2026-03-25 22:54:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-25 22:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 2
2026-03-25 22:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b544de51-e016-5cb2-ad6d-11e0b9f81209 with scrape type 2
2026-03-25 22:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b544de51-e016-5cb2-ad6d-11e0b9f81209, identifier: 1980410
2026-03-25 22:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-25 22:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410
2026-03-25 22:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b544de51-e016-5cb2-ad6d-11e0b9f81209 with identifier: 1980410 to the API
2026-03-25 22:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b544de51-e016-5cb2-ad6d-11e0b9f81209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE BERLINE',
 'odometer': 38448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE BERLINE 1.6 E-TECH 160 PHEV INTENS',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 160 PHEV INTENS',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980410%27 HTTP/1.1" 200 None
2026-03-25 22:54:42 [ayvens.be] INFO: Saving data for 1980410: {'auction_closing_time': 1774530000.0, 'created_time': 1774392837.220545, 'last_price_update_time': 1774479282.986739}
2026-03-25 22:54:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980410') HTTP/1.1" 204 0
2026-03-25 22:54:43 [ayvens.be] INFO: Found listing with ID: 1980411
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980411%27 HTTP/1.1" 200 None
2026-03-25 22:54:43 [ayvens.be] INFO: Scrape type for 1980411: 2
2026-03-25 22:54:43 [ayvens.be] INFO: Extracting data for car ID: 1980411
2026-03-25 22:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-25 22:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 2
2026-03-25 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768ee90d-9e68-5f82-b05d-5531b8607182 with scrape type 2
2026-03-25 22:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 768ee90d-9e68-5f82-b05d-5531b8607182, identifier: 1980411
2026-03-25 22:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-25 22:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411
2026-03-25 22:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 768ee90d-9e68-5f82-b05d-5531b8607182 with identifier: 1980411 to the API
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '768ee90d-9e68-5f82-b05d-5531b8607182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 119366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980411%27 HTTP/1.1" 200 None
2026-03-25 22:54:43 [ayvens.be] INFO: Saving data for 1980411: {'auction_closing_time': 1774530000.0, 'created_time': 1774392838.789385, 'last_price_update_time': 1774479283.358207}
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980411') HTTP/1.1" 204 0
2026-03-25 22:54:43 [ayvens.be] INFO: Found listing with ID: 1980412
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980412%27 HTTP/1.1" 200 None
2026-03-25 22:54:43 [ayvens.be] INFO: Scrape type for 1980412: 2
2026-03-25 22:54:43 [ayvens.be] INFO: Extracting data for car ID: 1980412
2026-03-25 22:54:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-25 22:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 2
2026-03-25 22:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f5a42c-df82-58fa-8fd9-3104414d6d3a with scrape type 2
2026-03-25 22:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15f5a42c-df82-58fa-8fd9-3104414d6d3a, identifier: 1980412
2026-03-25 22:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-25 22:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412
2026-03-25 22:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15f5a42c-df82-58fa-8fd9-3104414d6d3a with identifier: 1980412 to the API
2026-03-25 22:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '15f5a42c-df82-58fa-8fd9-3104414d6d3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 148205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI PLATINUM DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI PLATINUM DSG',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980412%27 HTTP/1.1" 200 None
2026-03-25 22:54:44 [ayvens.be] INFO: Saving data for 1980412: {'auction_closing_time': 1774530000.0, 'created_time': 1774392840.27482, 'last_price_update_time': 1774479284.343738}
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980412') HTTP/1.1" 204 0
2026-03-25 22:54:44 [ayvens.be] INFO: Found listing with ID: 1980413
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980413%27 HTTP/1.1" 200 None
2026-03-25 22:54:44 [ayvens.be] INFO: Scrape type for 1980413: 2
2026-03-25 22:54:44 [ayvens.be] INFO: Extracting data for car ID: 1980413
2026-03-25 22:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-25 22:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 2
2026-03-25 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1633be65-fc75-5ecc-9ded-a75cce69d482 with scrape type 2
2026-03-25 22:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1633be65-fc75-5ecc-9ded-a75cce69d482, identifier: 1980413
2026-03-25 22:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-25 22:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413
2026-03-25 22:54:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1633be65-fc75-5ecc-9ded-a75cce69d482 with identifier: 1980413 to the API
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '1633be65-fc75-5ecc-9ded-a75cce69d482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 82439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980413%27 HTTP/1.1" 200 None
2026-03-25 22:54:44 [ayvens.be] INFO: Saving data for 1980413: {'auction_closing_time': 1774530000.0, 'created_time': 1774392842.052515, 'last_price_update_time': 1774479284.725507}
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980413') HTTP/1.1" 204 0
2026-03-25 22:54:44 [ayvens.be] INFO: Found listing with ID: 1980414
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980414%27 HTTP/1.1" 200 None
2026-03-25 22:54:44 [ayvens.be] INFO: Scrape type for 1980414: 2
2026-03-25 22:54:44 [ayvens.be] INFO: Extracting data for car ID: 1980414
2026-03-25 22:54:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-25 22:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 2
2026-03-25 22:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69645680-dd88-54d6-bb22-6e98fa48909c with scrape type 2
2026-03-25 22:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 69645680-dd88-54d6-bb22-6e98fa48909c, identifier: 1980414
2026-03-25 22:54:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-25 22:54:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414
2026-03-25 22:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 69645680-dd88-54d6-bb22-6e98fa48909c with identifier: 1980414 to the API
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '69645680-dd88-54d6-bb22-6e98fa48909c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 98878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 530E 200KW XDRIVE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E 200KW XDRIVE AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980414%27 HTTP/1.1" 200 None
2026-03-25 22:54:45 [ayvens.be] INFO: Saving data for 1980414: {'auction_closing_time': 1774530000.0, 'created_time': 1774392843.229122, 'last_price_update_time': 1774479285.498077}
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980414') HTTP/1.1" 204 0
2026-03-25 22:54:45 [ayvens.be] INFO: Found listing with ID: 1980415
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980415%27 HTTP/1.1" 200 None
2026-03-25 22:54:45 [ayvens.be] INFO: Scrape type for 1980415: 2
2026-03-25 22:54:45 [ayvens.be] INFO: Extracting data for car ID: 1980415
2026-03-25 22:54:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-25 22:54:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 2
2026-03-25 22:54:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with scrape type 2
2026-03-25 22:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19, identifier: 1980415
2026-03-25 22:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-25 22:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415
2026-03-25 22:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8580ac67-a34c-5f62-8fe2-1d5c6cfeef19 with identifier: 1980415 to the API
2026-03-25 22:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8580ac67-a34c-5f62-8fe2-1d5c6cfeef19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 150736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980415%27 HTTP/1.1" 200 None
2026-03-25 22:54:46 [ayvens.be] INFO: Saving data for 1980415: {'auction_closing_time': 1774530000.0, 'created_time': 1774392844.826869, 'last_price_update_time': 1774479286.583643}
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980415') HTTP/1.1" 204 0
2026-03-25 22:54:46 [ayvens.be] INFO: Found listing with ID: 1980416
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980416%27 HTTP/1.1" 200 None
2026-03-25 22:54:46 [ayvens.be] INFO: Scrape type for 1980416: 2
2026-03-25 22:54:46 [ayvens.be] INFO: Extracting data for car ID: 1980416
2026-03-25 22:54:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-25 22:54:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 2
2026-03-25 22:54:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b18b9c8-f038-5154-8774-01efdde72620 with scrape type 2
2026-03-25 22:54:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b18b9c8-f038-5154-8774-01efdde72620, identifier: 1980416
2026-03-25 22:54:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-25 22:54:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416
2026-03-25 22:54:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b18b9c8-f038-5154-8774-01efdde72620 with identifier: 1980416 to the API
2026-03-25 22:54:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '2b18b9c8-f038-5154-8774-01efdde72620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 52411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRON. ADVANCED SPORTBACK',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980416%27 HTTP/1.1" 200 None
2026-03-25 22:54:47 [ayvens.be] INFO: Saving data for 1980416: {'auction_closing_time': 1774530000.0, 'created_time': 1774392846.319551, 'last_price_update_time': 1774479287.805377}
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980416') HTTP/1.1" 204 0
2026-03-25 22:54:47 [ayvens.be] INFO: Found listing with ID: 1980417
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980417%27 HTTP/1.1" 200 None
2026-03-25 22:54:47 [ayvens.be] INFO: Scrape type for 1980417: 2
2026-03-25 22:54:47 [ayvens.be] INFO: Extracting data for car ID: 1980417
2026-03-25 22:54:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-25 22:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 2
2026-03-25 22:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91c64d60-2a63-590b-be74-1f96dd9673c1 with scrape type 2
2026-03-25 22:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91c64d60-2a63-590b-be74-1f96dd9673c1, identifier: 1980417
2026-03-25 22:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-25 22:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417
2026-03-25 22:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 91c64d60-2a63-590b-be74-1f96dd9673c1 with identifier: 1980417 to the API
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '91c64d60-2a63-590b-be74-1f96dd9673c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 117173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980417%27 HTTP/1.1" 200 None
2026-03-25 22:54:48 [ayvens.be] INFO: Saving data for 1980417: {'auction_closing_time': 1774530000.0, 'created_time': 1774392848.655356, 'last_price_update_time': 1774479288.207475}
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980417') HTTP/1.1" 204 0
2026-03-25 22:54:48 [ayvens.be] INFO: Found listing with ID: 1980418
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980418%27 HTTP/1.1" 200 None
2026-03-25 22:54:48 [ayvens.be] INFO: Scrape type for 1980418: 2
2026-03-25 22:54:48 [ayvens.be] INFO: Extracting data for car ID: 1980418
2026-03-25 22:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-25 22:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with scrape type 2
2026-03-25 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with scrape type 2
2026-03-25 22:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90, identifier: 1980418
2026-03-25 22:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-25 22:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418
2026-03-25 22:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90 with identifier: 1980418 to the API
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c81bd3fc-fe82-5d60-8be8-e2c5e6fd5d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-Klasse',
 'odometer': 46869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-Klasse 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980418%27 HTTP/1.1" 200 None
2026-03-25 22:54:48 [ayvens.be] INFO: Saving data for 1980418: {'auction_closing_time': 1774530000.0, 'created_time': 1774392850.133425, 'last_price_update_time': 1774479288.588634}
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980418') HTTP/1.1" 204 0
2026-03-25 22:54:48 [ayvens.be] INFO: Found listing with ID: 1980419
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980419%27 HTTP/1.1" 200 None
2026-03-25 22:54:48 [ayvens.be] INFO: Scrape type for 1980419: 2
2026-03-25 22:54:48 [ayvens.be] INFO: Extracting data for car ID: 1980419
2026-03-25 22:54:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-25 22:54:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 2
2026-03-25 22:54:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a224006a-ecb1-5777-9c36-19cb2bd63777 with scrape type 2
2026-03-25 22:54:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a224006a-ecb1-5777-9c36-19cb2bd63777, identifier: 1980419
2026-03-25 22:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-25 22:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419
2026-03-25 22:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a224006a-ecb1-5777-9c36-19cb2bd63777 with identifier: 1980419 to the API
2026-03-25 22:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a224006a-ecb1-5777-9c36-19cb2bd63777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 80986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980419%27 HTTP/1.1" 200 None
2026-03-25 22:54:49 [ayvens.be] INFO: Saving data for 1980419: {'auction_closing_time': 1774530000.0, 'created_time': 1774392851.579217, 'last_price_update_time': 1774479289.268082}
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980419') HTTP/1.1" 204 0
2026-03-25 22:54:49 [ayvens.be] INFO: Found listing with ID: 1980420
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980420%27 HTTP/1.1" 200 None
2026-03-25 22:54:49 [ayvens.be] INFO: Scrape type for 1980420: 2
2026-03-25 22:54:49 [ayvens.be] INFO: Extracting data for car ID: 1980420
2026-03-25 22:54:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-25 22:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 2
2026-03-25 22:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with scrape type 2
2026-03-25 22:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8a785fe-b5d0-56fa-83f9-4fab89d7a362, identifier: 1980420
2026-03-25 22:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-25 22:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420
2026-03-25 22:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8a785fe-b5d0-56fa-83f9-4fab89d7a362 with identifier: 1980420 to the API
2026-03-25 22:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8a785fe-b5d0-56fa-83f9-4fab89d7a362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980420%27 HTTP/1.1" 200 None
2026-03-25 22:54:50 [ayvens.be] INFO: Saving data for 1980420: {'auction_closing_time': 1774530000.0, 'created_time': 1774392853.299853, 'last_price_update_time': 1774479290.67641}
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980420') HTTP/1.1" 204 0
2026-03-25 22:54:50 [ayvens.be] INFO: Found listing with ID: 1980421
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980421%27 HTTP/1.1" 200 None
2026-03-25 22:54:50 [ayvens.be] INFO: Scrape type for 1980421: 2
2026-03-25 22:54:50 [ayvens.be] INFO: Extracting data for car ID: 1980421
2026-03-25 22:54:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-25 22:54:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 2
2026-03-25 22:54:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bc6fecf-167b-51eb-acbf-41d488f8f507 with scrape type 2
2026-03-25 22:54:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0bc6fecf-167b-51eb-acbf-41d488f8f507, identifier: 1980421
2026-03-25 22:54:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-25 22:54:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421
2026-03-25 22:54:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0bc6fecf-167b-51eb-acbf-41d488f8f507 with identifier: 1980421 to the API
2026-03-25 22:54:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0bc6fecf-167b-51eb-acbf-41d488f8f507',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC COUPE',
 'odometer': 111879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC COUPE 2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980421%27 HTTP/1.1" 200 None
2026-03-25 22:54:51 [ayvens.be] INFO: Saving data for 1980421: {'auction_closing_time': 1774530000.0, 'created_time': 1774392854.740924, 'last_price_update_time': 1774479291.147351}
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980421') HTTP/1.1" 204 0
2026-03-25 22:54:51 [ayvens.be] INFO: Found listing with ID: 1980422
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980422%27 HTTP/1.1" 200 None
2026-03-25 22:54:51 [ayvens.be] INFO: Scrape type for 1980422: 2
2026-03-25 22:54:51 [ayvens.be] INFO: Extracting data for car ID: 1980422
2026-03-25 22:54:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-25 22:54:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 2
2026-03-25 22:54:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with scrape type 2
2026-03-25 22:54:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea, identifier: 1980422
2026-03-25 22:54:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-25 22:54:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422
2026-03-25 22:54:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e64cf68-a5f0-53b0-94d5-05c292bbbcea with identifier: 1980422 to the API
2026-03-25 22:54:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '1e64cf68-a5f0-53b0-94d5-05c292bbbcea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 147558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980422%27 HTTP/1.1" 200 None
2026-03-25 22:54:52 [ayvens.be] INFO: Saving data for 1980422: {'auction_closing_time': 1774530000.0, 'created_time': 1774392857.585508, 'last_price_update_time': 1774479292.593101}
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980422') HTTP/1.1" 204 0
2026-03-25 22:54:52 [ayvens.be] INFO: Found listing with ID: 1980423
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980423%27 HTTP/1.1" 200 None
2026-03-25 22:54:52 [ayvens.be] INFO: Scrape type for 1980423: 2
2026-03-25 22:54:52 [ayvens.be] INFO: Extracting data for car ID: 1980423
2026-03-25 22:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-25 22:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 2
2026-03-25 22:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09004bbc-6359-535b-a99e-b8b1fb675399 with scrape type 2
2026-03-25 22:54:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09004bbc-6359-535b-a99e-b8b1fb675399, identifier: 1980423
2026-03-25 22:54:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-25 22:54:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423
2026-03-25 22:54:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 09004bbc-6359-535b-a99e-b8b1fb675399 with identifier: 1980423 to the API
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '09004bbc-6359-535b-a99e-b8b1fb675399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 111269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980423%27 HTTP/1.1" 200 None
2026-03-25 22:54:52 [ayvens.be] INFO: Saving data for 1980423: {'auction_closing_time': 1774530000.0, 'created_time': 1774392860.093627, 'last_price_update_time': 1774479292.97733}
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980423') HTTP/1.1" 204 0
2026-03-25 22:54:52 [ayvens.be] INFO: Found listing with ID: 1980424
2026-03-25 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980424%27 HTTP/1.1" 200 None
2026-03-25 22:54:53 [ayvens.be] INFO: Scrape type for 1980424: 2
2026-03-25 22:54:53 [ayvens.be] INFO: Extracting data for car ID: 1980424
2026-03-25 22:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-25 22:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 2
2026-03-25 22:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with scrape type 2
2026-03-25 22:54:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3, identifier: 1980424
2026-03-25 22:54:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-25 22:54:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424
2026-03-25 22:54:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3 with identifier: 1980424 to the API
2026-03-25 22:54:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'ca63ae9b-a5c6-564e-8bc3-a8958d4aaaa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 180008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON 95 kWh 55 Quattro Advanced',
 'transmission': 'automatic',
 'trim': '95 kWh 55 Quattro Advanced',
 'vin': None,
 'year': 2020}
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980424%27 HTTP/1.1" 200 None
2026-03-25 22:54:54 [ayvens.be] INFO: Saving data for 1980424: {'auction_closing_time': 1774530000.0, 'created_time': 1774392860.687433, 'last_price_update_time': 1774479294.392122}
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980424') HTTP/1.1" 204 0
2026-03-25 22:54:54 [ayvens.be] INFO: Found listing with ID: 1980425
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980425%27 HTTP/1.1" 200 None
2026-03-25 22:54:54 [ayvens.be] INFO: Scrape type for 1980425: 2
2026-03-25 22:54:54 [ayvens.be] INFO: Extracting data for car ID: 1980425
2026-03-25 22:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-25 22:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 2
2026-03-25 22:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f6b86a-64a3-5986-ae46-4ef20370de69 with scrape type 2
2026-03-25 22:54:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 10f6b86a-64a3-5986-ae46-4ef20370de69, identifier: 1980425
2026-03-25 22:54:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-25 22:54:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425
2026-03-25 22:54:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 10f6b86a-64a3-5986-ae46-4ef20370de69 with identifier: 1980425 to the API
2026-03-25 22:54:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '10f6b86a-64a3-5986-ae46-4ef20370de69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 89827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.2 PURETECH 130 S-S SHINE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 130 S-S SHINE',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980425%27 HTTP/1.1" 200 None
2026-03-25 22:54:55 [ayvens.be] INFO: Saving data for 1980425: {'auction_closing_time': 1774530000.0, 'created_time': 1774392862.335255, 'last_price_update_time': 1774479295.156168}
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980425') HTTP/1.1" 204 0
2026-03-25 22:54:55 [ayvens.be] INFO: Found listing with ID: 1980426
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980426%27 HTTP/1.1" 200 None
2026-03-25 22:54:55 [ayvens.be] INFO: Scrape type for 1980426: 2
2026-03-25 22:54:55 [ayvens.be] INFO: Extracting data for car ID: 1980426
2026-03-25 22:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-25 22:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 2
2026-03-25 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ccbd74-4d59-5303-8962-b8d5e8bed838 with scrape type 2
2026-03-25 22:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a3ccbd74-4d59-5303-8962-b8d5e8bed838, identifier: 1980426
2026-03-25 22:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-25 22:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426
2026-03-25 22:54:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a3ccbd74-4d59-5303-8962-b8d5e8bed838 with identifier: 1980426 to the API
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a3ccbd74-4d59-5303-8962-b8d5e8bed838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 52536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 1.5 35 TFSI ADVANCED',
 'transmission': 'manual',
 'trim': '1.5 35 TFSI ADVANCED',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980426%27 HTTP/1.1" 200 None
2026-03-25 22:54:55 [ayvens.be] INFO: Saving data for 1980426: {'auction_closing_time': 1774530000.0, 'created_time': 1774392864.014633, 'last_price_update_time': 1774479295.78892}
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980426') HTTP/1.1" 204 0
2026-03-25 22:54:55 [ayvens.be] INFO: Found listing with ID: 1980427
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980427%27 HTTP/1.1" 200 None
2026-03-25 22:54:55 [ayvens.be] INFO: Scrape type for 1980427: 2
2026-03-25 22:54:55 [ayvens.be] INFO: Extracting data for car ID: 1980427
2026-03-25 22:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-25 22:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 2
2026-03-25 22:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1e7030-034b-5260-97c9-95ac6c87a369 with scrape type 2
2026-03-25 22:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8d1e7030-034b-5260-97c9-95ac6c87a369, identifier: 1980427
2026-03-25 22:54:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-25 22:54:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427
2026-03-25 22:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8d1e7030-034b-5260-97c9-95ac6c87a369 with identifier: 1980427 to the API
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d1e7030-034b-5260-97c9-95ac6c87a369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 127584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM 2.0TD 130PS MHEV TREND FWD 340 LWB',
 'transmission': 'manual',
 'trim': '2.0TD 130PS MHEV TREND FWD 340 LWB',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980427%27 HTTP/1.1" 200 None
2026-03-25 22:54:56 [ayvens.be] INFO: Saving data for 1980427: {'auction_closing_time': 1774530000.0, 'created_time': 1774392864.957724, 'last_price_update_time': 1774479296.862373}
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980427') HTTP/1.1" 204 0
2026-03-25 22:54:56 [ayvens.be] INFO: Found listing with ID: 1980428
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980428%27 HTTP/1.1" 200 None
2026-03-25 22:54:56 [ayvens.be] INFO: Scrape type for 1980428: 2
2026-03-25 22:54:56 [ayvens.be] INFO: Extracting data for car ID: 1980428
2026-03-25 22:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-25 22:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 2
2026-03-25 22:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd347170-1c5d-5705-a41d-ca213afde7f0 with scrape type 2
2026-03-25 22:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd347170-1c5d-5705-a41d-ca213afde7f0, identifier: 1980428
2026-03-25 22:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-25 22:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428
2026-03-25 22:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd347170-1c5d-5705-a41d-ca213afde7f0 with identifier: 1980428 to the API
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd347170-1c5d-5705-a41d-ca213afde7f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 48037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980428%27 HTTP/1.1" 200 None
2026-03-25 22:54:57 [ayvens.be] INFO: Saving data for 1980428: {'auction_closing_time': 1774530000.0, 'created_time': 1774392867.054007, 'last_price_update_time': 1774479297.28106}
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980428') HTTP/1.1" 204 0
2026-03-25 22:54:57 [ayvens.be] INFO: Found listing with ID: 1980429
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980429%27 HTTP/1.1" 200 None
2026-03-25 22:54:57 [ayvens.be] INFO: Scrape type for 1980429: 2
2026-03-25 22:54:57 [ayvens.be] INFO: Extracting data for car ID: 1980429
2026-03-25 22:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-25 22:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 2
2026-03-25 22:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 137c0adf-7bc5-5006-8a80-389121a630c5 with scrape type 2
2026-03-25 22:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 137c0adf-7bc5-5006-8a80-389121a630c5, identifier: 1980429
2026-03-25 22:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-25 22:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429
2026-03-25 22:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 137c0adf-7bc5-5006-8a80-389121a630c5 with identifier: 1980429 to the API
2026-03-25 22:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '137c0adf-7bc5-5006-8a80-389121a630c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 29940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980429%27 HTTP/1.1" 200 None
2026-03-25 22:54:58 [ayvens.be] INFO: Saving data for 1980429: {'auction_closing_time': 1774530000.0, 'created_time': 1774392868.640812, 'last_price_update_time': 1774479298.346375}
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980429') HTTP/1.1" 204 0
2026-03-25 22:54:58 [ayvens.be] INFO: Found listing with ID: 1980430
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980430%27 HTTP/1.1" 200 None
2026-03-25 22:54:58 [ayvens.be] INFO: Scrape type for 1980430: 2
2026-03-25 22:54:58 [ayvens.be] INFO: Extracting data for car ID: 1980430
2026-03-25 22:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-25 22:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 2
2026-03-25 22:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c7920fc-e9bf-5130-8ddf-61283075c353 with scrape type 2
2026-03-25 22:54:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c7920fc-e9bf-5130-8ddf-61283075c353, identifier: 1980430
2026-03-25 22:54:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-25 22:54:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430
2026-03-25 22:54:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c7920fc-e9bf-5130-8ddf-61283075c353 with identifier: 1980430 to the API
2026-03-25 22:54:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c7920fc-e9bf-5130-8ddf-61283075c353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980430%27 HTTP/1.1" 200 None
2026-03-25 22:54:59 [ayvens.be] INFO: Saving data for 1980430: {'auction_closing_time': 1774530000.0, 'created_time': 1774392870.974108, 'last_price_update_time': 1774479299.442391}
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980430') HTTP/1.1" 204 0
2026-03-25 22:54:59 [ayvens.be] INFO: Found listing with ID: 1980431
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980431%27 HTTP/1.1" 200 None
2026-03-25 22:54:59 [ayvens.be] INFO: Scrape type for 1980431: 2
2026-03-25 22:54:59 [ayvens.be] INFO: Extracting data for car ID: 1980431
2026-03-25 22:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-25 22:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 2
2026-03-25 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with scrape type 2
2026-03-25 22:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467, identifier: 1980431
2026-03-25 22:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-25 22:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431
2026-03-25 22:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467 with identifier: 1980431 to the API
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ca1cfd2-69bd-5bd7-bf5f-b01c074e3467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 169483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980431%27 HTTP/1.1" 200 None
2026-03-25 22:54:59 [ayvens.be] INFO: Saving data for 1980431: {'auction_closing_time': 1774530000.0, 'created_time': 1774392872.805399, 'last_price_update_time': 1774479299.819032}
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980431') HTTP/1.1" 204 0
2026-03-25 22:54:59 [ayvens.be] INFO: Found listing with ID: 1980432
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980432%27 HTTP/1.1" 200 None
2026-03-25 22:54:59 [ayvens.be] INFO: Scrape type for 1980432: 2
2026-03-25 22:54:59 [ayvens.be] INFO: Extracting data for car ID: 1980432
2026-03-25 22:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-25 22:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 2
2026-03-25 22:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with scrape type 2
2026-03-25 22:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c, identifier: 1980432
2026-03-25 22:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-25 22:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432
2026-03-25 22:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4f9c68b3-6983-5ac0-8bcd-39735c55a15c with identifier: 1980432 to the API
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4f9c68b3-6983-5ac0-8bcd-39735c55a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 105953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 1.4 TSI PHEV 160KW DSG6 CLEVER',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 160KW DSG6 CLEVER',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980432%27 HTTP/1.1" 200 None
2026-03-25 22:55:00 [ayvens.be] INFO: Saving data for 1980432: {'auction_closing_time': 1774530000.0, 'created_time': 1774392874.327053, 'last_price_update_time': 1774479300.221497}
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980432') HTTP/1.1" 204 0
2026-03-25 22:55:00 [ayvens.be] INFO: Found listing with ID: 1980433
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980433%27 HTTP/1.1" 200 None
2026-03-25 22:55:00 [ayvens.be] INFO: Scrape type for 1980433: 2
2026-03-25 22:55:00 [ayvens.be] INFO: Extracting data for car ID: 1980433
2026-03-25 22:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-25 22:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 2
2026-03-25 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0b083bf-6e40-5b10-aa61-972197b7bf06 with scrape type 2
2026-03-25 22:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0b083bf-6e40-5b10-aa61-972197b7bf06, identifier: 1980433
2026-03-25 22:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-25 22:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433
2026-03-25 22:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0b083bf-6e40-5b10-aa61-972197b7bf06 with identifier: 1980433 to the API
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd0b083bf-6e40-5b10-aa61-972197b7bf06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 188787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS 2.0 B 200 D BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '2.0 B 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980433%27 HTTP/1.1" 200 None
2026-03-25 22:55:00 [ayvens.be] INFO: Saving data for 1980433: {'auction_closing_time': 1774530000.0, 'created_time': 1774392875.102641, 'last_price_update_time': 1774479300.628517}
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980433') HTTP/1.1" 204 0
2026-03-25 22:55:00 [ayvens.be] INFO: Found listing with ID: 1980434
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980434%27 HTTP/1.1" 200 None
2026-03-25 22:55:00 [ayvens.be] INFO: Scrape type for 1980434: 2
2026-03-25 22:55:00 [ayvens.be] INFO: Extracting data for car ID: 1980434
2026-03-25 22:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-25 22:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 2
2026-03-25 22:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20b96f03-39fa-5bd4-85b8-d927562d4040 with scrape type 2
2026-03-25 22:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 20b96f03-39fa-5bd4-85b8-d927562d4040, identifier: 1980434
2026-03-25 22:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-25 22:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434
2026-03-25 22:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 20b96f03-39fa-5bd4-85b8-d927562d4040 with identifier: 1980434 to the API
2026-03-25 22:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '20b96f03-39fa-5bd4-85b8-d927562d4040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 91807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 1.0 30 TFSI 81KW',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI 81KW',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980434%27 HTTP/1.1" 200 None
2026-03-25 22:55:01 [ayvens.be] INFO: Saving data for 1980434: {'auction_closing_time': 1774530000.0, 'created_time': 1774392876.744902, 'last_price_update_time': 1774479301.768292}
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980434') HTTP/1.1" 204 0
2026-03-25 22:55:01 [ayvens.be] INFO: Found listing with ID: 1980435
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980435%27 HTTP/1.1" 200 None
2026-03-25 22:55:01 [ayvens.be] INFO: Scrape type for 1980435: 2
2026-03-25 22:55:01 [ayvens.be] INFO: Extracting data for car ID: 1980435
2026-03-25 22:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-25 22:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 2
2026-03-25 22:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 585391de-3103-5b60-94d9-9311ab472214 with scrape type 2
2026-03-25 22:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 585391de-3103-5b60-94d9-9311ab472214, identifier: 1980435
2026-03-25 22:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-25 22:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435
2026-03-25 22:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 585391de-3103-5b60-94d9-9311ab472214 with identifier: 1980435 to the API
2026-03-25 22:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '585391de-3103-5b60-94d9-9311ab472214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 114666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980435%27 HTTP/1.1" 200 None
2026-03-25 22:55:02 [ayvens.be] INFO: Saving data for 1980435: {'auction_closing_time': 1774530000.0, 'created_time': 1774392878.780191, 'last_price_update_time': 1774479302.134268}
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980435') HTTP/1.1" 204 0
2026-03-25 22:55:02 [ayvens.be] INFO: Found listing with ID: 1980436
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980436%27 HTTP/1.1" 200 None
2026-03-25 22:55:02 [ayvens.be] INFO: Scrape type for 1980436: 2
2026-03-25 22:55:02 [ayvens.be] INFO: Extracting data for car ID: 1980436
2026-03-25 22:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-25 22:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 2
2026-03-25 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a020241f-9671-558c-b1cb-37c2c25a38ed with scrape type 2
2026-03-25 22:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a020241f-9671-558c-b1cb-37c2c25a38ed, identifier: 1980436
2026-03-25 22:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-25 22:55:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 22:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436
2026-03-25 22:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a020241f-9671-558c-b1cb-37c2c25a38ed with identifier: 1980436 to the API
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'a020241f-9671-558c-b1cb-37c2c25a38ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 31331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980436%27 HTTP/1.1" 200 None
2026-03-25 22:55:02 [ayvens.be] INFO: Saving data for 1980436: {'auction_closing_time': 1774530000.0, 'created_time': 1774392880.657454, 'last_price_update_time': 1774479302.62704}
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980436') HTTP/1.1" 204 0
2026-03-25 22:55:02 [ayvens.be] INFO: Found listing with ID: 1980437
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980437%27 HTTP/1.1" 200 None
2026-03-25 22:55:02 [ayvens.be] INFO: Scrape type for 1980437: 2
2026-03-25 22:55:02 [ayvens.be] INFO: Extracting data for car ID: 1980437
2026-03-25 22:55:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-25 22:55:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 2
2026-03-25 22:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd5e129c-9014-5e1f-8926-20ca8a02deb0 with scrape type 2
2026-03-25 22:55:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd5e129c-9014-5e1f-8926-20ca8a02deb0, identifier: 1980437
2026-03-25 22:55:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-25 22:55:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437
2026-03-25 22:55:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd5e129c-9014-5e1f-8926-20ca8a02deb0 with identifier: 1980437 to the API
2026-03-25 22:55:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bd5e129c-9014-5e1f-8926-20ca8a02deb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 187410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV CORE DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV CORE DCT',
 'vin': None,
 'year': 2023}
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980437%27 HTTP/1.1" 200 None
2026-03-25 22:55:03 [ayvens.be] INFO: Saving data for 1980437: {'auction_closing_time': 1774530000.0, 'created_time': 1774392881.372848, 'last_price_update_time': 1774479303.451455}
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980437') HTTP/1.1" 204 0
2026-03-25 22:55:03 [ayvens.be] INFO: Found listing with ID: 1980438
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980438%27 HTTP/1.1" 200 None
2026-03-25 22:55:03 [ayvens.be] INFO: Scrape type for 1980438: 2
2026-03-25 22:55:03 [ayvens.be] INFO: Extracting data for car ID: 1980438
2026-03-25 22:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-25 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 2
2026-03-25 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065560d5-73ef-5e5a-8e8e-13da0a591f77 with scrape type 2
2026-03-25 22:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 065560d5-73ef-5e5a-8e8e-13da0a591f77, identifier: 1980438
2026-03-25 22:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-25 22:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438
2026-03-25 22:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 065560d5-73ef-5e5a-8e8e-13da0a591f77 with identifier: 1980438 to the API
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '065560d5-73ef-5e5a-8e8e-13da0a591f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'E-CLASS BREAK',
 'odometer': 78233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ E-CLASS BREAK 2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 E 300 DE AUTO BUSINESS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980438%27 HTTP/1.1" 200 None
2026-03-25 22:55:03 [ayvens.be] INFO: Saving data for 1980438: {'auction_closing_time': 1774530000.0, 'created_time': 1774392883.063762, 'last_price_update_time': 1774479303.829285}
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980438') HTTP/1.1" 204 0
2026-03-25 22:55:03 [ayvens.be] INFO: Found listing with ID: 1980439
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980439%27 HTTP/1.1" 200 None
2026-03-25 22:55:03 [ayvens.be] INFO: Scrape type for 1980439: 2
2026-03-25 22:55:03 [ayvens.be] INFO: Extracting data for car ID: 1980439
2026-03-25 22:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-25 22:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 2
2026-03-25 22:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e70e0a53-f615-5e36-8282-b789dd1802c1 with scrape type 2
2026-03-25 22:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e70e0a53-f615-5e36-8282-b789dd1802c1, identifier: 1980439
2026-03-25 22:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-25 22:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439
2026-03-25 22:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e70e0a53-f615-5e36-8282-b789dd1802c1 with identifier: 1980439 to the API
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e70e0a53-f615-5e36-8282-b789dd1802c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 71679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980439%27 HTTP/1.1" 200 None
2026-03-25 22:55:04 [ayvens.be] INFO: Saving data for 1980439: {'auction_closing_time': 1774530000.0, 'created_time': 1774392884.722354, 'last_price_update_time': 1774479304.198258}
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980439') HTTP/1.1" 204 0
2026-03-25 22:55:04 [ayvens.be] INFO: Found listing with ID: 1980440
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980440%27 HTTP/1.1" 200 None
2026-03-25 22:55:04 [ayvens.be] INFO: Scrape type for 1980440: 2
2026-03-25 22:55:04 [ayvens.be] INFO: Extracting data for car ID: 1980440
2026-03-25 22:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-25 22:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 2
2026-03-25 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9474db12-7db3-5b4b-b87e-d1af39983ce6 with scrape type 2
2026-03-25 22:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9474db12-7db3-5b4b-b87e-d1af39983ce6, identifier: 1980440
2026-03-25 22:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-25 22:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440
2026-03-25 22:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9474db12-7db3-5b4b-b87e-d1af39983ce6 with identifier: 1980440 to the API
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9474db12-7db3-5b4b-b87e-d1af39983ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 164062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980440%27 HTTP/1.1" 200 None
2026-03-25 22:55:04 [ayvens.be] INFO: Saving data for 1980440: {'auction_closing_time': 1774530000.0, 'created_time': 1774392885.650531, 'last_price_update_time': 1774479304.586692}
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980440') HTTP/1.1" 204 0
2026-03-25 22:55:04 [ayvens.be] INFO: Found listing with ID: 1980441
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980441%27 HTTP/1.1" 200 None
2026-03-25 22:55:04 [ayvens.be] INFO: Scrape type for 1980441: 2
2026-03-25 22:55:04 [ayvens.be] INFO: Extracting data for car ID: 1980441
2026-03-25 22:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-25 22:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0d07666-6771-5589-95ce-953971248d4a with scrape type 2
2026-03-25 22:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0d07666-6771-5589-95ce-953971248d4a with scrape type 2
2026-03-25 22:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d0d07666-6771-5589-95ce-953971248d4a, identifier: 1980441
2026-03-25 22:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-25 22:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441
2026-03-25 22:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d0d07666-6771-5589-95ce-953971248d4a with identifier: 1980441 to the API
2026-03-25 22:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd0d07666-6771-5589-95ce-953971248d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 93800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980441%27 HTTP/1.1" 200 None
2026-03-25 22:55:05 [ayvens.be] INFO: Saving data for 1980441: {'auction_closing_time': 1774530000.0, 'created_time': 1774392887.576599, 'last_price_update_time': 1774479305.856558}
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980441') HTTP/1.1" 204 0
2026-03-25 22:55:05 [ayvens.be] INFO: Found listing with ID: 1980442
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980442%27 HTTP/1.1" 200 None
2026-03-25 22:55:05 [ayvens.be] INFO: Scrape type for 1980442: 2
2026-03-25 22:55:05 [ayvens.be] INFO: Extracting data for car ID: 1980442
2026-03-25 22:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-25 22:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 2
2026-03-25 22:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 053c27bf-20c6-52f1-897d-b564c8a68ac2 with scrape type 2
2026-03-25 22:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 053c27bf-20c6-52f1-897d-b564c8a68ac2, identifier: 1980442
2026-03-25 22:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-25 22:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442
2026-03-25 22:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 053c27bf-20c6-52f1-897d-b564c8a68ac2 with identifier: 1980442 to the API
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '053c27bf-20c6-52f1-897d-b564c8a68ac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 33578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980442%27 HTTP/1.1" 200 None
2026-03-25 22:55:06 [ayvens.be] INFO: Saving data for 1980442: {'auction_closing_time': 1774530000.0, 'created_time': 1774392888.82477, 'last_price_update_time': 1774479306.226911}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980442') HTTP/1.1" 204 0
2026-03-25 22:55:06 [ayvens.be] INFO: Found listing with ID: 1980443
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980443%27 HTTP/1.1" 200 None
2026-03-25 22:55:06 [ayvens.be] INFO: Scrape type for 1980443: 2
2026-03-25 22:55:06 [ayvens.be] INFO: Extracting data for car ID: 1980443
2026-03-25 22:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-25 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 2
2026-03-25 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b02a049f-23ad-52f2-a198-bcbf99a914dd with scrape type 2
2026-03-25 22:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b02a049f-23ad-52f2-a198-bcbf99a914dd, identifier: 1980443
2026-03-25 22:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-25 22:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443
2026-03-25 22:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b02a049f-23ad-52f2-a198-bcbf99a914dd with identifier: 1980443 to the API
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b02a049f-23ad-52f2-a198-bcbf99a914dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 116175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 180 D BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '2.0 GLB 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980443%27 HTTP/1.1" 200 None
2026-03-25 22:55:06 [ayvens.be] INFO: Saving data for 1980443: {'auction_closing_time': 1774530000.0, 'created_time': 1774392891.166488, 'last_price_update_time': 1774479306.595234}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980443') HTTP/1.1" 204 0
2026-03-25 22:55:06 [ayvens.be] INFO: Found listing with ID: 1980444
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980444%27 HTTP/1.1" 200 None
2026-03-25 22:55:06 [ayvens.be] INFO: Scrape type for 1980444: 2
2026-03-25 22:55:06 [ayvens.be] INFO: Extracting data for car ID: 1980444
2026-03-25 22:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-25 22:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 2
2026-03-25 22:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7d428a-e542-54a6-9d6b-4241d510c1db with scrape type 2
2026-03-25 22:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8c7d428a-e542-54a6-9d6b-4241d510c1db, identifier: 1980444
2026-03-25 22:55:06 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 1 pages/min), scraped 651 items (at 80 items/min)
2026-03-25 22:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-25 22:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-25 22:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444
2026-03-25 22:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8c7d428a-e542-54a6-9d6b-4241d510c1db with identifier: 1980444 to the API
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c7d428a-e542-54a6-9d6b-4241d510c1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES BERLINE',
 'odometer': 97195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES BERLINE 2.0 518D 100KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 518D 100KW AUTO',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980444%27 HTTP/1.1" 200 None
2026-03-25 22:55:06 [ayvens.be] INFO: Saving data for 1980444: {'auction_closing_time': 1774530000.0, 'created_time': 1774392891.974302, 'last_price_update_time': 1774479306.986039}
2026-03-25 22:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980444') HTTP/1.1" 204 0
2026-03-25 22:55:07 [ayvens.be] INFO: Found listing with ID: 1980445
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980445%27 HTTP/1.1" 200 None
2026-03-25 22:55:07 [ayvens.be] INFO: Scrape type for 1980445: 2
2026-03-25 22:55:07 [ayvens.be] INFO: Extracting data for car ID: 1980445
2026-03-25 22:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-25 22:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b27291-52b1-5bb8-8777-db035e76e519 with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82b27291-52b1-5bb8-8777-db035e76e519, identifier: 1980445
2026-03-25 22:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-25 22:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445
2026-03-25 22:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82b27291-52b1-5bb8-8777-db035e76e519 with identifier: 1980445 to the API
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '82b27291-52b1-5bb8-8777-db035e76e519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5 SERIES TOURING',
 'odometer': 167994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 SERIES TOURING 2.0 530E 200KW XDRIVE AUTO TOURING',
 'transmission': 'manual',
 'trim': '2.0 530E 200KW XDRIVE AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980445%27 HTTP/1.1" 200 None
2026-03-25 22:55:07 [ayvens.be] INFO: Saving data for 1980445: {'auction_closing_time': 1774530000.0, 'created_time': 1774392894.230038, 'last_price_update_time': 1774479307.369523}
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980445') HTTP/1.1" 204 0
2026-03-25 22:55:07 [ayvens.be] INFO: Found listing with ID: 1980446
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980446%27 HTTP/1.1" 200 None
2026-03-25 22:55:07 [ayvens.be] INFO: Scrape type for 1980446: 2
2026-03-25 22:55:07 [ayvens.be] INFO: Extracting data for car ID: 1980446
2026-03-25 22:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-25 22:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 798339c6-1db7-59a9-a77e-53ec4e304705 with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 798339c6-1db7-59a9-a77e-53ec4e304705, identifier: 1980446
2026-03-25 22:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-25 22:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446
2026-03-25 22:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 798339c6-1db7-59a9-a77e-53ec4e304705 with identifier: 1980446 to the API
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '798339c6-1db7-59a9-a77e-53ec4e304705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 100208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'transmission': 'automatic',
 'trim': '1.4 40 TFSI E S TRONIC SPORTB ATTRACTION',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980446%27 HTTP/1.1" 200 None
2026-03-25 22:55:07 [ayvens.be] INFO: Saving data for 1980446: {'auction_closing_time': 1774530000.0, 'created_time': 1774392895.68412, 'last_price_update_time': 1774479307.725941}
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980446') HTTP/1.1" 204 0
2026-03-25 22:55:07 [ayvens.be] INFO: Found listing with ID: 1980447
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980447%27 HTTP/1.1" 200 None
2026-03-25 22:55:07 [ayvens.be] INFO: Scrape type for 1980447: 2
2026-03-25 22:55:07 [ayvens.be] INFO: Extracting data for car ID: 1980447
2026-03-25 22:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-25 22:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8056c5c7-d393-5672-9245-8472e244201c with scrape type 2
2026-03-25 22:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8056c5c7-d393-5672-9245-8472e244201c, identifier: 1980447
2026-03-25 22:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-25 22:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447
2026-03-25 22:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8056c5c7-d393-5672-9245-8472e244201c with identifier: 1980447 to the API
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8056c5c7-d393-5672-9245-8472e244201c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 123049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 318IA (115KW) AUTO TOURING',
 'transmission': 'automatic',
 'trim': '2.0 318IA (115KW) AUTO TOURING',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980447%27 HTTP/1.1" 200 None
2026-03-25 22:55:08 [ayvens.be] INFO: Saving data for 1980447: {'auction_closing_time': 1774530000.0, 'created_time': 1774392896.611824, 'last_price_update_time': 1774479308.229002}
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980447') HTTP/1.1" 204 0
2026-03-25 22:55:08 [ayvens.be] INFO: Found listing with ID: 1980448
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980448%27 HTTP/1.1" 200 None
2026-03-25 22:55:08 [ayvens.be] INFO: Scrape type for 1980448: 2
2026-03-25 22:55:08 [ayvens.be] INFO: Extracting data for car ID: 1980448
2026-03-25 22:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-25 22:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 2
2026-03-25 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with scrape type 2
2026-03-25 22:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1, identifier: 1980448
2026-03-25 22:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-25 22:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448
2026-03-25 22:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bc44d0a9-f1ab-5254-a16c-d37ec9f284b1 with identifier: 1980448 to the API
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bc44d0a9-f1ab-5254-a16c-d37ec9f284b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 61928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E PHEV 162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV 162KW)',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980448%27 HTTP/1.1" 200 None
2026-03-25 22:55:08 [ayvens.be] INFO: Saving data for 1980448: {'auction_closing_time': 1774530000.0, 'created_time': 1774392899.773418, 'last_price_update_time': 1774479308.608028}
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980448') HTTP/1.1" 204 0
2026-03-25 22:55:08 [ayvens.be] INFO: Found listing with ID: 1980449
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980449%27 HTTP/1.1" 200 None
2026-03-25 22:55:08 [ayvens.be] INFO: Scrape type for 1980449: 2
2026-03-25 22:55:08 [ayvens.be] INFO: Extracting data for car ID: 1980449
2026-03-25 22:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-25 22:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 2
2026-03-25 22:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f362f5-e8a6-53e4-8caa-f5b14f161748 with scrape type 2
2026-03-25 22:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45f362f5-e8a6-53e4-8caa-f5b14f161748, identifier: 1980449
2026-03-25 22:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-25 22:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449
2026-03-25 22:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45f362f5-e8a6-53e4-8caa-f5b14f161748 with identifier: 1980449 to the API
2026-03-25 22:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '45f362f5-e8a6-53e4-8caa-f5b14f161748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 18362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 64KWH SINGLE MOTOR STANDARD RANGE',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980449%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Saving data for 1980449: {'auction_closing_time': 1774530000.0, 'created_time': 1774392900.945955, 'last_price_update_time': 1774479310.115319}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980449') HTTP/1.1" 204 0
2026-03-25 22:55:10 [ayvens.be] INFO: Found listing with ID: 1980450
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980450%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Scrape type for 1980450: 2
2026-03-25 22:55:10 [ayvens.be] INFO: Extracting data for car ID: 1980450
2026-03-25 22:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-25 22:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 2
2026-03-25 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8418b0c-8e4b-50f5-ba81-68414125e1f9 with scrape type 2
2026-03-25 22:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8418b0c-8e4b-50f5-ba81-68414125e1f9, identifier: 1980450
2026-03-25 22:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-25 22:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450
2026-03-25 22:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8418b0c-8e4b-50f5-ba81-68414125e1f9 with identifier: 1980450 to the API
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8418b0c-8e4b-50f5-ba81-68414125e1f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 35359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 ZEN',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 ZEN',
 'vin': None,
 'year': 2022}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980450%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Saving data for 1980450: {'auction_closing_time': 1774530000.0, 'created_time': 1774392902.386969, 'last_price_update_time': 1774479310.518268}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980450') HTTP/1.1" 204 0
2026-03-25 22:55:10 [ayvens.be] INFO: Found listing with ID: 1980451
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980451%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Scrape type for 1980451: 2
2026-03-25 22:55:10 [ayvens.be] INFO: Extracting data for car ID: 1980451
2026-03-25 22:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-25 22:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 2
2026-03-25 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71689947-0945-541e-84e9-3ae7080dcfea with scrape type 2
2026-03-25 22:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 71689947-0945-541e-84e9-3ae7080dcfea, identifier: 1980451
2026-03-25 22:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-25 22:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451
2026-03-25 22:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 71689947-0945-541e-84e9-3ae7080dcfea with identifier: 1980451 to the API
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '71689947-0945-541e-84e9-3ae7080dcfea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK',
 'odometer': 144429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK 2.0 30 TDI S TRONIC BUS. ED.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI S TRONIC BUS. ED.',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980451%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Saving data for 1980451: {'auction_closing_time': 1774530000.0, 'created_time': 1774392904.095498, 'last_price_update_time': 1774479310.904979}
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980451') HTTP/1.1" 204 0
2026-03-25 22:55:10 [ayvens.be] INFO: Found listing with ID: 1980452
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980452%27 HTTP/1.1" 200 None
2026-03-25 22:55:10 [ayvens.be] INFO: Scrape type for 1980452: 2
2026-03-25 22:55:10 [ayvens.be] INFO: Extracting data for car ID: 1980452
2026-03-25 22:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-25 22:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 2
2026-03-25 22:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ec46de6-e866-5be7-9224-6fd57651e59d with scrape type 2
2026-03-25 22:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ec46de6-e866-5be7-9224-6fd57651e59d, identifier: 1980452
2026-03-25 22:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-25 22:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452
2026-03-25 22:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4ec46de6-e866-5be7-9224-6fd57651e59d with identifier: 1980452 to the API
2026-03-25 22:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ec46de6-e866-5be7-9224-6fd57651e59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 60599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2023}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980452%27 HTTP/1.1" 200 None
2026-03-25 22:55:12 [ayvens.be] INFO: Saving data for 1980452: {'auction_closing_time': 1774530000.0, 'created_time': 1774392906.10062, 'last_price_update_time': 1774479312.144793}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980452') HTTP/1.1" 204 0
2026-03-25 22:55:12 [ayvens.be] INFO: Found listing with ID: 1980453
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980453%27 HTTP/1.1" 200 None
2026-03-25 22:55:12 [ayvens.be] INFO: Scrape type for 1980453: 2
2026-03-25 22:55:12 [ayvens.be] INFO: Extracting data for car ID: 1980453
2026-03-25 22:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-25 22:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 2
2026-03-25 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df76a12-ab1c-5bdf-9805-12191f762d3c with scrape type 2
2026-03-25 22:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1df76a12-ab1c-5bdf-9805-12191f762d3c, identifier: 1980453
2026-03-25 22:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-25 22:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453
2026-03-25 22:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1df76a12-ab1c-5bdf-9805-12191f762d3c with identifier: 1980453 to the API
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'STD',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'electric',
 'id': '1df76a12-ab1c-5bdf-9805-12191f762d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'MIRAI',
 'odometer': 1895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA MIRAI Mirai Fuel Cell',
 'transmission': 'automatic',
 'trim': 'Mirai Fuel Cell',
 'vin': None,
 'year': 2020}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980453%27 HTTP/1.1" 200 None
2026-03-25 22:55:12 [ayvens.be] INFO: Saving data for 1980453: {'auction_closing_time': 1774530000.0, 'created_time': 1774392907.213972, 'last_price_update_time': 1774479312.520905}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980453') HTTP/1.1" 204 0
2026-03-25 22:55:12 [ayvens.be] INFO: Found listing with ID: 1980454
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980454%27 HTTP/1.1" 200 None
2026-03-25 22:55:12 [ayvens.be] INFO: Scrape type for 1980454: 2
2026-03-25 22:55:12 [ayvens.be] INFO: Extracting data for car ID: 1980454
2026-03-25 22:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-25 22:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 2
2026-03-25 22:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with scrape type 2
2026-03-25 22:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021, identifier: 1980454
2026-03-25 22:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-25 22:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454
2026-03-25 22:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6f95b6f5-ec00-5c09-9f02-b54ca7a1e021 with identifier: 1980454 to the API
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '6f95b6f5-ec00-5c09-9f02-b54ca7a1e021',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2020}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980454%27 HTTP/1.1" 200 None
2026-03-25 22:55:12 [ayvens.be] INFO: Saving data for 1980454: {'auction_closing_time': 1774530000.0, 'created_time': 1774392908.961568, 'last_price_update_time': 1774479312.95975}
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980454') HTTP/1.1" 204 0
2026-03-25 22:55:12 [ayvens.be] INFO: Found listing with ID: 1980455
2026-03-25 22:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980455%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980455: 2
2026-03-25 22:55:13 [ayvens.be] INFO: Extracting data for car ID: 1980455
2026-03-25 22:55:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-25 22:55:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 2
2026-03-25 22:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85d66156-2e3e-548c-8bbb-85097e13616c with scrape type 2
2026-03-25 22:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85d66156-2e3e-548c-8bbb-85097e13616c, identifier: 1980455
2026-03-25 22:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-25 22:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455
2026-03-25 22:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85d66156-2e3e-548c-8bbb-85097e13616c with identifier: 1980455 to the API
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 22:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '85d66156-2e3e-548c-8bbb-85097e13616c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/40978',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 93888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2021}
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980455%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Saving data for 1980455: {'auction_closing_time': 1774530000.0, 'created_time': 1774392912.478578, 'last_price_update_time': 1774479313.361737}
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1980455') HTTP/1.1" 204 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980456
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980456%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980456: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980457
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980457%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980457: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980458
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980458%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980458: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980459
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980459%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980459: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980460
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980460%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980460: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980461
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980461%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980461: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980462
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980462%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980462: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980463
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980463%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980463: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980464
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980464%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980464: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980465
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980465%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980465: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980466
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980466%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980466: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980467
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980467%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980467: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980468
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980468%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980468: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980469
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980469%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980469: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980470
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980470%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980470: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980471
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980471%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980471: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980472
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980472%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980472: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980473
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980473%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980473: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980474
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980474%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980474: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980475
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980475%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980475: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980476
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980476%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980476: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980477
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980477%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980477: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980478
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980478%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980478: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980479
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980479%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980479: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980480
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980480%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980480: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980481
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980481%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980481: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980482
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980482%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980482: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980483
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980483%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980483: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980484
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980484%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980484: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980485
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980485%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980485: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980486
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980486%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980486: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980487
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980487%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980487: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980488
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980488%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980488: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980489
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980489%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980489: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980490
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980490%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980490: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980491
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980491%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980491: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980492
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980492%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980492: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980493
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980493%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980493: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980494
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980494%27 HTTP/1.1" 200 None
2026-03-25 22:55:13 [ayvens.be] INFO: Scrape type for 1980494: 0
2026-03-25 22:55:13 [ayvens.be] INFO: Found listing with ID: 1980495
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980495%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980495: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980496
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980496%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980496: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980497
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980497%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980497: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980498
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980498%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980498: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980499
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980499%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980499: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980500
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980500%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980500: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980501
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980501%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980501: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980502
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980502%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980502: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Found listing with ID: 1980503
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980503%27 HTTP/1.1" 200 None
2026-03-25 22:55:14 [ayvens.be] INFO: Scrape type for 1980503: 0
2026-03-25 22:55:14 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-03-25 22:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980504
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980504%27 HTTP/1.1" 200 None
2026-03-25 22:55:15 [ayvens.be] INFO: Scrape type for 1980504: 0
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980505
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980505%27 HTTP/1.1" 200 None
2026-03-25 22:55:15 [ayvens.be] INFO: Scrape type for 1980505: 0
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980506
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980506%27 HTTP/1.1" 200 None
2026-03-25 22:55:15 [ayvens.be] INFO: Scrape type for 1980506: 0
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980507
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980507%27 HTTP/1.1" 200 None
2026-03-25 22:55:15 [ayvens.be] INFO: Scrape type for 1980507: 0
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980508
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980508%27 HTTP/1.1" 200 None
2026-03-25 22:55:15 [ayvens.be] INFO: Scrape type for 1980508: 0
2026-03-25 22:55:15 [ayvens.be] INFO: Found listing with ID: 1980509
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980509%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980509: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980510
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980510%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980510: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980511
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980511%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980511: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980512
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980512%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980512: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980513
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980513%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980513: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980514
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980514%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980514: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980515
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980515%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980515: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980516
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980516%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980516: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980517
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980517%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980517: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980518
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980518%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980518: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980519
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980519%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980519: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980520
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980520%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980520: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980521
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980521%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980521: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980522
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980522%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980522: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980523
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980523%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980523: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980524
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980524%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980524: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980525
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980525%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980525: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980526
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980526%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980526: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980527
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980527%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980527: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980528
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980528%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980528: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980529
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980529%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980529: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980530
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980530%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980530: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980531
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980531%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980531: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980532
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980532%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980532: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980533
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980533%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980533: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980534
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980534%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980534: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980535
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980535%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980535: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980536
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980536%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980536: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980537
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980537%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980537: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980538
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980538%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980538: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980539
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980539%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980539: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980540
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980540%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980540: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980541
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980541%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980541: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980542
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980542%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980542: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980543
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980543%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980543: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980544
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980544%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980544: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980545
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980545%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980545: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980546
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980546%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980546: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980547
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980547%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980547: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980548
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980548%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980548: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980549
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980549%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980549: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980550
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980550%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980550: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980551
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980551%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980551: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980552
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980552%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980552: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980553
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980553%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980553: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980554
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980554%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980554: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980555
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980555%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980555: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980556
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980556%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980556: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980557
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980557%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980557: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980558
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980558%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980558: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980559
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980559%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980559: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980560
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980560%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980560: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980561
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980561%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980561: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980562
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980562%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980562: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980563
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980563%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980563: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980564
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980564%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980564: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980565
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980565%27 HTTP/1.1" 200 None
2026-03-25 22:55:16 [ayvens.be] INFO: Scrape type for 1980565: 0
2026-03-25 22:55:16 [ayvens.be] INFO: Found listing with ID: 1980566
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980566%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980566: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980567
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980567%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980567: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980568
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980568%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980568: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980569
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980569%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980569: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980570
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980570%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980570: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980571
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980571%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980571: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980572
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980572%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980572: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980573
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980573%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980573: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980574
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980574%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980574: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980575
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980575%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980575: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980576
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980576%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980576: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980577
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980577%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980577: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980578
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980578%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980578: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980579
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980579%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980579: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980580
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980580%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980580: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980581
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980581%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980581: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980582
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980582%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980582: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980583
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980583%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980583: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980584
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980584%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980584: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980585
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980585%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980585: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980586
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980586%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980586: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980587
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980587%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980587: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980588
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980588%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980588: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980589
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980589%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980589: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980590
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980590%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980590: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980591
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980591%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980591: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980592
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980592%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980592: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980593
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980593%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980593: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980594
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980594%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980594: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980595
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980595%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980595: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980596
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980596%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980596: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980597
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980597%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980597: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980598
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980598%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980598: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980599
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980599%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980599: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980600
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980600%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980600: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980601
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980601%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980601: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980602
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980602%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980602: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Found listing with ID: 1980603
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980603%27 HTTP/1.1" 200 None
2026-03-25 22:55:17 [ayvens.be] INFO: Scrape type for 1980603: 0
2026-03-25 22:55:17 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 900
2026-03-25 22:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1980604
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271980604%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1980604: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974467
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974467%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974467: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974468
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974468%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974468: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974469
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974469%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974469: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974470
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974470%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974470: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974471
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974471%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974471: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974472
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974472%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974472: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974473
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974473%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974473: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974474
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974474%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974474: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974475
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974475%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974475: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974476
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974476%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974476: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974477
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974477%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974477: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974478
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974478%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974478: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974479
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974479%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974479: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974480
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974480%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974480: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974481
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974481%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974481: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974482
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974482%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974482: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974483
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974483%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974483: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974484
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974484%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974484: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974485
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974485%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974485: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974486
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974486%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974486: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974487
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974487%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974487: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974488
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974488%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974488: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974489
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974489%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974489: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974490
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974490%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974490: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974491
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974491%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974491: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974492
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974492%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974492: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974493
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974493%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974493: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974494
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974494%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974494: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974495
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974495%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974495: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974496
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974496%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974496: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974497
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974497%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974497: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974498
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974498%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974498: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974499
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974499%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974499: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974500
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974500%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974500: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974501
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974501%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974501: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974502
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974502%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974502: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974503
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974503%27 HTTP/1.1" 200 None
2026-03-25 22:55:19 [ayvens.be] INFO: Scrape type for 1974503: 0
2026-03-25 22:55:19 [ayvens.be] INFO: Found listing with ID: 1974504
2026-03-25 22:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974504%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974504: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974505
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974505%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974505: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974506
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974506%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974506: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974507
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974507%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974507: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974508
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974508%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974508: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974509
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974509%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974509: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974510
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974510%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974510: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974511
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974511%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974511: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974512
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974512%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974512: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974513
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974513%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974513: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974514
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974514%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974514: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974515
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974515%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974515: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974516
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974516%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974516: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974517
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974517%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974517: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974518
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974518%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974518: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974519
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974519%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974519: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974520
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974520%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974520: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974521
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974521%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974521: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974522
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974522%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974522: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974523
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974523%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974523: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974524
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974524%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974524: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974525
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974525%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974525: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974526
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974526%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974526: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974527
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974527%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974527: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974528
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974528%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974528: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974529
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974529%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974529: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974530
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974530%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974530: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974531
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974531%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974531: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974532
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974532%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974532: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974533
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974533%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974533: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974534
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974534%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974534: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974535
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974535%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974535: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974536
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974536%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974536: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974537
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974537%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974537: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974538
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974538%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974538: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974539
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974539%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974539: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974540
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974540%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974540: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974541
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974541%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974541: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974542
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974542%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974542: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974543
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974543%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974543: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974544
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974544%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974544: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974545
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974545%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974545: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974546
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974546%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974546: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974547
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974547%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974547: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974548
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974548%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974548: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974549
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974549%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974549: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974550
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974550%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974550: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974551
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974551%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974551: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974552
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974552%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974552: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974553
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974553%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974553: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974554
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974554%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974554: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974555
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974555%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974555: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974556
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974556%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974556: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974557
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974557%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974557: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974558
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974558%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974558: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974559
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974559%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974559: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974560
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974560%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974560: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974561
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974561%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974561: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974562
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974562%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974562: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974563
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974563%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974563: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974564
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974564%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974564: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Found listing with ID: 1974565
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974565%27 HTTP/1.1" 200 None
2026-03-25 22:55:20 [ayvens.be] INFO: Scrape type for 1974565: 0
2026-03-25 22:55:20 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1000
2026-03-25 22:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974566
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974566%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974566: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974567
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974567%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974567: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974568
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974568%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974568: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974569
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974569%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974569: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974570
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974570%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974570: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974571
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974571%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974571: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974572
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974572%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974572: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974573
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974573%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974573: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974574
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974574%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974574: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974575
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974575%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974575: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974576
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974576%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974576: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974577
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974577%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974577: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974578
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974578%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974578: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974579
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974579%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974579: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974580
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974580%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974580: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974581
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974581%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974581: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974582
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974582%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974582: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974583
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974583%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974583: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974584
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974584%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974584: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974585
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974585%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974585: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974586
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974586%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974586: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974587
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974587%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974587: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974588
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974588%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974588: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974589
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974589%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974589: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974590
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974590%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974590: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974591
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974591%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974591: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974592
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974592%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974592: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974593
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974593%27 HTTP/1.1" 200 None
2026-03-25 22:55:23 [ayvens.be] INFO: Scrape type for 1974593: 0
2026-03-25 22:55:23 [ayvens.be] INFO: Found listing with ID: 1974594
2026-03-25 22:55:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974594%27 HTTP/1.1" 200 None
2026-03-25 22:55:24 [ayvens.be] INFO: Scrape type for 1974594: 0
2026-03-25 22:55:24 [ayvens.be] INFO: Found listing with ID: 1974595
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974595%27 HTTP/1.1" 200 None
2026-03-25 22:55:24 [ayvens.be] INFO: Scrape type for 1974595: 0
2026-03-25 22:55:24 [ayvens.be] INFO: Found listing with ID: 1974596
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974596%27 HTTP/1.1" 200 None
2026-03-25 22:55:24 [ayvens.be] INFO: Scrape type for 1974596: 0
2026-03-25 22:55:24 [ayvens.be] INFO: Found listing with ID: 1974597
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271974597%27 HTTP/1.1" 200 None
2026-03-25 22:55:24 [ayvens.be] INFO: Scrape type for 1974597: 0
2026-03-25 22:55:24 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 1100
2026-03-25 22:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 22:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 22:55:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 22:55:25 [ayvens.be] INFO: ayvens.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 9, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 280, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-25 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 22:55:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20last_price_update_time%20lt%201774047325 HTTP/1.1" 200 None
2026-03-25 22:55:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (663 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.be/task_34_2026-03-25T22_45_00.jl
2026-03-25 22:55:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1026920,
 'downloader/request_count': 2193,
 'downloader/request_method_count/GET': 2181,
 'downloader/request_method_count/POST': 12,
 'downloader/response_bytes': 1311965758,
 'downloader/response_count': 2193,
 'downloader/response_status_count/200': 2193,
 'elapsed_time_seconds': 618.687449,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 22, 55, 25, 375313, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 663,
 'log_count/DEBUG': 22536,
 'log_count/INFO': 23850,
 'memusage/max': 192413696,
 'memusage/startup': 148168704,
 'photo_download_count': 2180,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 138,
 'playwright/request_count/aborted': 14,
 'playwright/request_count/method/GET': 134,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 6,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 27,
 'playwright/request_count/resource_type/script': 81,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 119,
 'playwright/response_count/method/GET': 116,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 5,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 11,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 12,
 'response_received_count': 13,
 'scheduler/dequeued': 2193,
 'scheduler/dequeued/memory': 2193,
 'scheduler/enqueued': 2193,
 'scheduler/enqueued/memory': 2193,
 'scrape_type/new': 218,
 'scrape_type/price_update': 445,
 'scrape_type/skipped': 369,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 12,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.0967014443594962,
 'scrapy-zyte-api/mean_response_seconds': 2.1901624900832153,
 'scrapy-zyte-api/processed': 12,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 12,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 12,
 'scrapy-zyte-api/request_args/httpRequestBody': 12,
 'scrapy-zyte-api/request_args/httpRequestMethod': 12,
 'scrapy-zyte-api/request_args/httpResponseBody': 12,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 12,
 'scrapy-zyte-api/request_args/url': 12,
 'scrapy-zyte-api/status_codes/200': 12,
 'scrapy-zyte-api/success': 12,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 22, 45, 6, 687864, tzinfo=datetime.timezone.utc)}
2026-03-25 22:55:25 [scrapy.core.engine] INFO: Spider closed (finished)